Heman Kumar M
Data Engineer | ETL Pipeline Development | IBM DataStage | Azure Cloud | Databricks | SQL
Hire this person
Send a job offer directly to this candidate
About
Results-driven Data Engineer and ETL Developer with around 7 years of IT experience, including 4+ years of expertise in IBM DataStage ETL development and 2 years in modern Data Engineering technologies. Skilled in designing, developing, and maintaining scalable data integration and transformation solutions across on-premises and cloud platforms. Hands-on experience with IBM DataStage, Azure Data Factory (ADF), Databricks, PySpark, SQL, and Azure DevOps.
Strong knowledge of ETL/ELT pipeline development, data warehousing, workflow optimization, CI/CD implementation, and production support. Proven ability to build reliable, high-performance, and analytics-ready data solutions that support business intelligence and reporting requirements.
Experience
Senior Engineer at Marlabs Innovation Pvt Ltd (2024-08 – Present)
- Design and develop cloud-based ETL pipelines using Azure Data Factory (ADF) for large-scale data ingestion and transformation with finance and operations domains.
- Build and maintain scalable data processing frameworks using Databricks and PySpark to handle high-volume datasets.
- Implement end-to-end data integration pipelines from source systems to Landing, Bronze, Silver, and Gold layers, and load into data warehouse structures (Fact & Dimension tables).
- Develop and deploy CI/CD pipelines using Azure DevOps (YAML) to automate code promotion across environments.
- Automated deployment workflows, reducing manual effort and errors.
- Perform unit testing and support UAT, collaborating with business stakeholders to ensure data accuracy and requirement alignment.
- Conduct data validation, reconciliation, and quality checks to maintain high data integrity standards.
- Optimized ETL pipelines, improving performance and reducing processing time
Software Engineer at CGI (2023-05 – 2024-08)
- Monitored and supported scheduled ETL workflows using ESP Scheduler, ensuring timely and reliable data processing.
- Investigated and resolved production incidents, including job failures, data mismatches, performance issues, and SLA breaches.
- Analyzed DataStage job logs and metadata to perform root cause analysis and implemented permanent fixes to prevent recurrence.
- Coordinated with upstream and downstream teams to ensure seamless data flow and issue resolution.
- Contributed to improving system stability and operational efficiency in production environments. Improved SLA adherence by resolving critical job failures.
Software Engineer at HCLTech (2021-10 – 2023-04)
- Designed and developed Parallel Jobs and Sequence Jobs using IBM DataStage to orchestrate complex ETL workflows.
- Implemented Slowly Changing Dimensions (SCD Type 1 & Type 2) to maintain historical data in dimension tables.
- Developed Change Data Capture (CDC) processes for efficient incremental data loading.
- Wrote optimized SQL queries for Oracle and DB2 databases for data extraction and validation.
- Participated in Agile Scrum ceremonies, design discussions, and code reviews.
Analyst at Ebix Technologies (2021-03 – 2021-09)
- Supported insurance domain operations.
Software Engineer at ZydeSoft Solutions (2019-03 – 2020-09)
- Provided production support for DataStage ETL pipelines and monitored scheduled batch jobs.
- Validated daily data loads and ensured data accuracy across systems.
- Documented incidents and resolutions, contributing to root cause analysis and knowledge base improvement.
- Supported timely issue resolution to maintain SLA compliance.
Education
B.Tech in Mechanical Engineering – Priyadarshini Engineering College


