Ahitagni Pai

Data Engineer with 2+ years of experience building enterprise-scale Azure data platforms. Expertise in Azure Databricks, ADF, PySpark, Delta Lake, and medallion architecture across SAP migration and ML-driven financial analytics workloads. IBM GEM Award recipient (FY 2025–26) for outstanding contribution to data platform modernization for the client.

Data Engineer at IBM (2024-01 – Present)

Delivered end-to-end Azure data engineering solutions across multiple enterprise programs for one of the world's largest energy companies (Client: Shell).

• Developed scalable ADF and Databricks pipelines leveraging Delta Lake, processing 4+ TB of data, supporting SAP BW/HANA/ECC migration and ML-driven financial forecasting workloads.
• Implemented metadata-driven ingestion frameworks using ADF and Delta Lake, reducing onboarding effort by 60%+ and ingestion runtimes by up to 68%.
• Led performance optimization across ADF, Azure Synapse, and SQL workloads — cutting large-scale mart load runtimes from 40+ hours to ~6 hours (~85% improvement).
• Implemented enterprise data governance using Unity Catalog and row-level security across multi-layer lakehouse architectures serving global business stakeholders.

B.Tech in Computer Science & Engineering – Netaji Subhash Engineering College, Kolkata (2019 – 2023)