Shubham Mittal

Senior Data Engineer with 4+ years building cloud-native data platforms on Azure, processing daily and cutting pipeline overhead by 70%. Expert in Medallion Architecture, PySpark, Databricks, and Gen AI integration by creating vector embeddings.

Senior Data Engineer at Fractal Analytics (2024-04 – Present)

• Architected and owned end-to-end batch & real-time pipelines for CPG brands (Databricks, Delta Lake, PySpark, Python) enabling analytics at scale.
• Led Medallion Architecture design (Bronze/Silver/Gold), improving data reliability and reducing downstream query times.
• Implemented enterprise data governance via Unity Catalog and Azure AD, ensuring compliance and secure access across data.
• Integrated Gen AI and vector embeddings into data workflows, enabling leadership to surface competitive intelligence from multi-source enterprise data.
• Mentored junior engineers on PySpark best practices, pipeline design, and data quality standards.

Specialist Programmer – Big Data at Infosys (2021-08 – 2024-04)

• Built scalable pipelines (ADF, Synapse, Databricks, Snowflake) processing 1TB+ data daily for global supply chain clients.
• Optimised PySpark workflows, reducing processing time and redundancy by 70%, directly improving SLA adherence.
• Designed Azure Data Lake and Cosmos DB storage solutions, improving data availability and retrieval performance.
• Led SIT and UAT cycles as primary technical owner — zero critical post-release defects across all deliverables.
• Bridged engineering and product teams by translating stakeholder requirements into robust technical designs.

B.Tech in Computer Science – Maharaja Agrasen Institute of Technology (2017 – 2021)