Skip to main content
Mukesh Kumar

Mukesh Kumar

Data Engineer

Talent
ChennaiMember since May 2, 2026
SQLPySparkSparkDatabricksDelta LakeAzure Data FactoryADLSMonitoringETL/ELTAgile
·

Hire this person

Send a job offer directly to this candidate

SQLPySparkSparkDatabricksDelta Lake

About

Certified Microsoft Fabric Data Engineer (DP-700) with over 3 years of experience in designing and deploying scalable ETL/ELT pipelines for Fintech applications. Expert in Azure Data Factory (ADF), Databricks, and PySpark, with a proven track record of implementing Medallion Architectures and optimizing Spark jobs to reduce compute costs by 15%. Strong background in CI/CD integration and cross-functional Agile collaboration to deliver high-quality data products.

Experience

Software Engineer (Data Engineer) at CGI Inc. – CIBC (2023-01 – Present)

  • Data Pipeline Engineering: Designed and deployed scalable ETL/ELT pipelines using Azure Data Factory (ADF) to ingest data from relational databases, REST APIs, and flat files into ADLS Gen 2 and Azure SQL DB.
  • Modern Data Architecture: Implemented a Medallion Architecture (Bronze, Silver, Gold layers) within Databricks using PySpark to streamline structured and semi-structured data processing.
  • Performance Optimization: Executed performance tuning strategies that reduced Spark job runtimes by 25% and decreased overall cloud compute costs by 15%.
  • Standardization & Scalability: Developed parameterized, reusable ADF pipeline templates to standardize data ingestion, significantly improving the maintainability of enterprise workflows.
  • System Integration: Managed complex data integration across Azure SQL DB, Azure Blob, and ADLS, leveraging expert knowledge of Delta Lake and Spark optimization.
  • DevOps & Monitoring: Orchestrated robust data pipelines with full CI/CD integration, automated testing, and proactive monitoring to ensure data health and system reliability.
  • Stakeholder Collaboration: Partnered with architects and business analysts in an Agile environment to translate complex requirements into actionable data products

Education

B.Tech in CSE – Birla Institute Of Technology, Mesra (2019 – 2023)

Senior Secondary – D.A.V Public School, Gumla (2017 – 2019)

High School – D.A.V Public School, Gumla (2016 – 2017)

Skills

Data Engineer

Reviews

Related