Senior Software Engineer (ADE) at YuppTV India Pvt Ltd (2023-10 – 2025-12)
Built end-to-end ETL/ELT pipelines and implemented Medallion Architecture for data quality improvement
- Built end-to-end ETL/ELT pipelines in Azure Data Factory to ingest data from SQL Server and REST APIs into ADLS Gen2
- Developed PySpark transformation workflows in Azure Databricks for large-scale vehicle and material movement data
- Implemented Medallion Architecture (Bronze-Silver-Gold) to improve data quality, consistency, and reporting efficiency
- Developed watermark-based incremental loading to process only new and updated records, reducing pipeline runtime
- Improved query performance using partitioning, caching, and Z-ORDER optimization
- Tech Stack: Azure Data Factory, Azure Databricks, ADLS Gen2, Delta Lake, PySpark, Azure SQL DB, Git
Senior Software Engineer (Data Engineer) at Chaivel IT Solutions (2022-08 – 2023-08)
Designed ADF pipelines for healthcare revenue cycle data processing with Medallion Architecture implementation
- Designed ADF pipelines to ingest patient claims, billing, and provider data from on-premises SQL Server and REST APIs into ADLS Gen2, processing 300K+ revenue transactions daily with zero data loss
- Built Medallion Architecture in Azure Databricks using PySpark, transforming raw claims and remittance data into analytics-ready aggregated datasets and reducing revenue cycle reporting time by 40%
- Developed Silver-layer data quality checks for claim ID validation, duplicate EOB detection, and schema enforcement, improving downstream billing accuracy by 35% and reducing claim rejection rates
- Implemented incremental load patterns using ADF watermark strategy and Delta Lake MERGE INTO, reducing pipeline execution time by 55% compared with full loads
- Automated ADF pipeline monitoring and alerting using Azure Monitor and Log Analytics, reducing mean incident resolution time by 30%
- Optimized Databricks cluster configurations and Spark execution plans, reducing daily compute costs by 20%
- Tech Stack: Azure Data Factory, Azure Databricks, ADLS Gen2, Delta Lake, PySpark, Azure SQL DB, Git
Senior Software Engineer (Data Engineer) at Chaivel IT Solutions (2022-08 – 2023-08)
HRCM Project - Insolvency & Banking Data Platform
- Architected and delivered a scalable data lakehouse on ADLS Gen2 using Medallion Architecture, consolidating 8 upstream source systems into a unified analytics layer serving 200+ internal users
- Built 15+ ADF pipelines with parameterized linked services and dynamic datasets, reducing pipeline development effort for new sources by 50%
- Engineered PySpark-based transformation logic in Databricks for interest calculation, fee reconciliation, and tax aggregation, eliminating 40% of manual financial corrections
- Implemented SCD Type 2 patterns using Delta Lake to ensure historical lineage and auditability for regulatory reporting
- Optimized SQL queries and Spark jobs processing 2M+ financial records, reducing query execution time by 60% and overnight batch window from 6 hours to 2.5 hours
- Established a data quality validation framework using Great Expectations integrated with ADF pipelines, catching 95%+ of anomalies before Gold-layer landing
- Integrated Azure DevOps CI/CD pipelines for ADF ARM template deployments across Dev, QA, and Prod, reducing deployment errors by 70% and enabling weekly release cycles
- Tech Stack: Azure Data Factory, Azure Databricks, ADLS Gen2, Delta Lake, PySpark, Azure SQL DB, Azure DevOps, Python, SQL Server, Git
Software Engineer at Vsplash Techlabs Pvt Ltd (2021-12 – 2022-04)
Developed dynamic and responsive web applications using Angular
- Developed dynamic and responsive web applications using Angular
- Migrated legacy applications to modern frameworks and improved UI performance
- Handled cross-browser compatibility and responsive design
Software Engineer at Karvy Forde Search Private Limited (2018-05 – 2019-04)
Developed dynamic and responsive web applications with UI component design
- Developed dynamic and responsive web applications using Angular
- Designed and developed responsive UI components using HTML, CSS, and Bootstrap
