Fahad Ali

Data Engineer with 4.8 years of experience designing and managing scalable cloud data pipelines using Azure Data Factory, Databricks, Synapse, and Data Lake. Skilled in Spark, Python, SQL, and Power BI. Strong in ETL/ELT development, data integration, performance optimization, and delivering reliable analytics solutions aligned with business needs.

Azure Data Engineer at Accenture (2024-01 – Present)

Built scalable ETL/ELT pipelines using Azure Data Factory, Databricks, Synapse, and Data Lake for analytics and reporting. Developed optimized Spark transformations and integrated data from multiple sources.

• Built scalable ETL/ELT pipelines using Azure Data Factory, Databricks, Synapse, and Data Lake for analytics and reporting.
• Developed optimized Spark transformations using PySpark and SQL for high-volume data processing.
• Integrated data from multiple sources with strong validation, data quality checks.
• Collaborated with cross-functional teams to analyze business needs and translate them into optimized data engineering solutions.
• Monitored pipeline performance, automated deployments via CI/CD, and supported production operations.

Azure Data Engineer at Cognizant (2021-01 – 2024-12)

Orchestrated ETL workflows using Azure Data Factory and Databricks, implementing Medallion Architecture to efficiently transform, validate, and load high-quality datasets into Azure Data Lake.

• Orchestrated ETL workflows using Azure Data Factory and Databricks, implementing Medallion Architecture (Bronze, Silver, Gold layers) to efficiently transform, validate, and load high-quality datasets into Azure Data Lake.
• Developed PySpark scripts for data validation, quality checks, and debugging to ensure data accuracy.
• Optimized data pipelines to improve performance, reliability, and timely processing.
• Collaborated with senior engineers and business teams to gather requirements and implement enhancements.

Bachelor of Technology (B.Tech) in Computer Science & Engineering – Galgotias University (2017 – 2021)