Skip to main content
Heman Kumar M

Heman Kumar M

Data Engineer | ETL Pipeline Development | IBM DataStage | Azure Cloud | Databricks | SQL

Talent
VelloreMember since June 13, 2026
IBM DataStageAzure Data FactoryDatabricksPySparkAzure DevOpsSQLCi/cd PipelinesEtl
·

Hire this person

Send a job offer directly to this candidate

IBM DataStageAzure Data FactoryDatabricksPySparkAzure DevOps

About

Results-driven Data Engineer and ETL Developer with around 7 years of IT experience, including 4+ years of expertise in IBM DataStage ETL development and 2 years in modern Data Engineering technologies. Skilled in designing, developing, and maintaining scalable data integration and transformation solutions across on-premises and cloud platforms. Hands-on experience with IBM DataStage, Azure Data Factory (ADF), Databricks, PySpark, SQL, and Azure DevOps.

Strong knowledge of ETL/ELT pipeline development, data warehousing, workflow optimization, CI/CD implementation, and production support. Proven ability to build reliable, high-performance, and analytics-ready data solutions that support business intelligence and reporting requirements.

Experience

Senior Engineer at Marlabs Innovation Pvt Ltd (2024-08 – Present)

  • Design and develop cloud-based ETL pipelines using Azure Data Factory (ADF) for large-scale data ingestion and transformation with finance and operations domains.
  • Build and maintain scalable data processing frameworks using Databricks and PySpark to handle high-volume datasets.
  • Implement end-to-end data integration pipelines from source systems to Landing, Bronze, Silver, and Gold layers, and load into data warehouse structures (Fact & Dimension tables).
  • Develop and deploy CI/CD pipelines using Azure DevOps (YAML) to automate code promotion across environments.
  • Automated deployment workflows, reducing manual effort and errors.
  • Perform unit testing and support UAT, collaborating with business stakeholders to ensure data accuracy and requirement alignment.
  • Conduct data validation, reconciliation, and quality checks to maintain high data integrity standards.
  • Optimized ETL pipelines, improving performance and reducing processing time

Software Engineer at CGI (2023-05 – 2024-08)

  • Monitored and supported scheduled ETL workflows using ESP Scheduler, ensuring timely and reliable data processing.
  • Investigated and resolved production incidents, including job failures, data mismatches, performance issues, and SLA breaches.
  • Analyzed DataStage job logs and metadata to perform root cause analysis and implemented permanent fixes to prevent recurrence.
  • Coordinated with upstream and downstream teams to ensure seamless data flow and issue resolution.
  • Contributed to improving system stability and operational efficiency in production environments. Improved SLA adherence by resolving critical job failures.

Software Engineer at HCLTech (2021-10 – 2023-04)

  • Designed and developed Parallel Jobs and Sequence Jobs using IBM DataStage to orchestrate complex ETL workflows.
  • Implemented Slowly Changing Dimensions (SCD Type 1 & Type 2) to maintain historical data in dimension tables.
  • Developed Change Data Capture (CDC) processes for efficient incremental data loading.
  • Wrote optimized SQL queries for Oracle and DB2 databases for data extraction and validation.
  • Participated in Agile Scrum ceremonies, design discussions, and code reviews.

Analyst at Ebix Technologies (2021-03 – 2021-09)

  • Supported insurance domain operations.

Software Engineer at ZydeSoft Solutions (2019-03 – 2020-09)

  • Provided production support for DataStage ETL pipelines and monitored scheduled batch jobs.
  • Validated daily data loads and ensured data accuracy across systems.
  • Documented incidents and resolutions, contributing to root cause analysis and knowledge base improvement.
  • Supported timely issue resolution to maintain SLA compliance.

Education

B.Tech in Mechanical Engineering – Priyadarshini Engineering College

Skills

Data EngineerETL Pipeline DevelopmentIBM DataStageAzure CloudDatabricksSQL

Reviews

Related