Skip to main content
Ramesh Lamba

Ramesh Lamba

Data Engineer

Talent
HyderabadMember since April 22, 2026
Azure DatabricksADLS Gen2Delta LakeMicrosoft FabricOneLakeLakehouseWarehouseAzure SQLETL/ELT pipeline designPySparkSparkData cleaningData validationData quality checksBatch processingIncremental loadingWatermark strategyDelta Lake MERGE INTOSCD Type 2Medallion ArchitectureData warehousingStar schemaSnowflake schemaPartitioningPerformance optimizationAzure DevOpsGitCI/CD pipelinesSQLPythonAngularHTMLCSSBootstrapAzure MonitorLog AnalyticsGreat Expectations
·

Hire this person

Send a job offer directly to this candidate

Azure DatabricksADLS Gen2Delta LakeMicrosoft FabricOneLake

About

Azure Data Engineer with 4.7 years of total IT experience, including 3.2 years of focused data engineering experience across Azure-based data platforms. Strong experience in Azure Data Factory, Azure Databricks, ADLS Gen2, PySpark, Delta Lake, and Medallion Architecture for building scalable ETL/ELT pipelines and analytics-ready datasets. The resume emphasizes recruiter-relevant keywords, concise summaries, and impact-oriented bullets because ATS-friendly data engineering resumes are easier to shortlist when core tools and measurable outcomes are clearly front-loaded.

Experience

Senior Software Engineer (ADE) at YuppTV India Pvt Ltd (2023-10 – 2025-12)

Built end-to-end ETL/ELT pipelines and implemented Medallion Architecture for data quality improvement

  • Built end-to-end ETL/ELT pipelines in Azure Data Factory to ingest data from SQL Server and REST APIs into ADLS Gen2
  • Developed PySpark transformation workflows in Azure Databricks for large-scale vehicle and material movement data
  • Implemented Medallion Architecture (Bronze-Silver-Gold) to improve data quality, consistency, and reporting efficiency
  • Developed watermark-based incremental loading to process only new and updated records, reducing pipeline runtime
  • Improved query performance using partitioning, caching, and Z-ORDER optimization
  • Tech Stack: Azure Data Factory, Azure Databricks, ADLS Gen2, Delta Lake, PySpark, Azure SQL DB, Git

Senior Software Engineer (Data Engineer) at Chaivel IT Solutions (2022-08 – 2023-08)

Designed ADF pipelines for healthcare revenue cycle data processing with Medallion Architecture implementation

  • Designed ADF pipelines to ingest patient claims, billing, and provider data from on-premises SQL Server and REST APIs into ADLS Gen2, processing 300K+ revenue transactions daily with zero data loss
  • Built Medallion Architecture in Azure Databricks using PySpark, transforming raw claims and remittance data into analytics-ready aggregated datasets and reducing revenue cycle reporting time by 40%
  • Developed Silver-layer data quality checks for claim ID validation, duplicate EOB detection, and schema enforcement, improving downstream billing accuracy by 35% and reducing claim rejection rates
  • Implemented incremental load patterns using ADF watermark strategy and Delta Lake MERGE INTO, reducing pipeline execution time by 55% compared with full loads
  • Automated ADF pipeline monitoring and alerting using Azure Monitor and Log Analytics, reducing mean incident resolution time by 30%
  • Optimized Databricks cluster configurations and Spark execution plans, reducing daily compute costs by 20%
  • Tech Stack: Azure Data Factory, Azure Databricks, ADLS Gen2, Delta Lake, PySpark, Azure SQL DB, Git

Senior Software Engineer (Data Engineer) at Chaivel IT Solutions (2022-08 – 2023-08)

HRCM Project - Insolvency & Banking Data Platform

  • Architected and delivered a scalable data lakehouse on ADLS Gen2 using Medallion Architecture, consolidating 8 upstream source systems into a unified analytics layer serving 200+ internal users
  • Built 15+ ADF pipelines with parameterized linked services and dynamic datasets, reducing pipeline development effort for new sources by 50%
  • Engineered PySpark-based transformation logic in Databricks for interest calculation, fee reconciliation, and tax aggregation, eliminating 40% of manual financial corrections
  • Implemented SCD Type 2 patterns using Delta Lake to ensure historical lineage and auditability for regulatory reporting
  • Optimized SQL queries and Spark jobs processing 2M+ financial records, reducing query execution time by 60% and overnight batch window from 6 hours to 2.5 hours
  • Established a data quality validation framework using Great Expectations integrated with ADF pipelines, catching 95%+ of anomalies before Gold-layer landing
  • Integrated Azure DevOps CI/CD pipelines for ADF ARM template deployments across Dev, QA, and Prod, reducing deployment errors by 70% and enabling weekly release cycles
  • Tech Stack: Azure Data Factory, Azure Databricks, ADLS Gen2, Delta Lake, PySpark, Azure SQL DB, Azure DevOps, Python, SQL Server, Git

Software Engineer at Vsplash Techlabs Pvt Ltd (2021-12 – 2022-04)

Developed dynamic and responsive web applications using Angular

  • Developed dynamic and responsive web applications using Angular
  • Migrated legacy applications to modern frameworks and improved UI performance
  • Handled cross-browser compatibility and responsive design

Software Engineer at Karvy Forde Search Private Limited (2018-05 – 2019-04)

Developed dynamic and responsive web applications with UI component design

  • Developed dynamic and responsive web applications using Angular
  • Designed and developed responsive UI components using HTML, CSS, and Bootstrap

Education

Bachelor of Technology in Computer Science & Engineering – Indur Institute of Engineering & Technology (JNTU-H) (2016)

Skills

Data Engineer

Reviews

Related