Data Engineer at Nice Software Solutions
- Engineered ADF pipelines and Azure Runbooks to automate complex data orchestration and reduce manual operational overhead.
- Led Microsoft Fabric PoCs, implementing secure data ingestion and fine-grained access control (RBAC) within the Data Warehouse.
- Architected data cleansing and validation logic in Databricks, utilizing Spark to ensure high-integrity datasets.
Data Engineer at LTIMindtree
Data Engineer with over 2 years of experience designing and delivering end-to-end data solutions using Azure Data Factory (ADF), Databricks, and PySpark.
- Designed and developed scalable data pipelines using Azure Data Factory and Azure Databricks.
- Implemented Medallion Architecture (Bronze, Silver, Gold) using Delta Lake.
- Developed PySpark transformations including cleansing, deduplication, joins, and aggregations.
- Implemented incremental loading using Delta MERGE and optimized Spark jobs using partitioning, broadcast joins.
- Handled corrupt records and implemented data validation framework.
- Monitored and troubleshot pipeline and Spark job failures.
- Collaborated with Business Analysts to implement business logic and delivered curated datasets for Power BI dashboards.
Maximo Consultant at LTIMindtree
Collaborated in the Maximo Practice team for 2 years, developing customizations using Application Designer, Python, and SQL.
- Converted over 50 BIRT reports and automated stored procedures to the SQL Server ecosystem, ensuring full compatibility.
- Led successful modernization of legacy systems by migrating databases and procedures from Oracle to Microsoft SQL Server.
