
Mukesh Kumar
Data Engineer
Hire this person
Send a job offer directly to this candidate
About
Certified Microsoft Fabric Data Engineer (DP-700) with over 3 years of experience in designing and deploying scalable ETL/ELT pipelines for Fintech applications. Expert in Azure Data Factory (ADF), Databricks, and PySpark, with a proven track record of implementing Medallion Architectures and optimizing Spark jobs to reduce compute costs by 15%. Strong background in CI/CD integration and cross-functional Agile collaboration to deliver high-quality data products.
Experience
Software Engineer (Data Engineer) at CGI Inc. – CIBC (2023-01 – Present)
- Data Pipeline Engineering: Designed and deployed scalable ETL/ELT pipelines using Azure Data Factory (ADF) to ingest data from relational databases, REST APIs, and flat files into ADLS Gen 2 and Azure SQL DB.
- Modern Data Architecture: Implemented a Medallion Architecture (Bronze, Silver, Gold layers) within Databricks using PySpark to streamline structured and semi-structured data processing.
- Performance Optimization: Executed performance tuning strategies that reduced Spark job runtimes by 25% and decreased overall cloud compute costs by 15%.
- Standardization & Scalability: Developed parameterized, reusable ADF pipeline templates to standardize data ingestion, significantly improving the maintainability of enterprise workflows.
- System Integration: Managed complex data integration across Azure SQL DB, Azure Blob, and ADLS, leveraging expert knowledge of Delta Lake and Spark optimization.
- DevOps & Monitoring: Orchestrated robust data pipelines with full CI/CD integration, automated testing, and proactive monitoring to ensure data health and system reliability.
- Stakeholder Collaboration: Partnered with architects and business analysts in an Agile environment to translate complex requirements into actionable data products
Education
B.Tech in CSE – Birla Institute Of Technology, Mesra (2019 – 2023)
Senior Secondary – D.A.V Public School, Gumla (2017 – 2019)
High School – D.A.V Public School, Gumla (2016 – 2017)
