Amit Patil

Results-driven Senior Data Engineering Leader with over 17 years of experience, including over 12 years delivering enterprise-scale data platforms and cloud migration programmes for Fortune 500 clients across banking, credit cards, insurance, retail, and logistics domains. Proven expertise in modernising legacy ETL and ELT workloads to cloud-native architectures on AWS, Azure, and Snowflake, with measurable outcomes including 40% reduction in pipeline processing time and 50 to 60% end-to-end pipeline automation. Deep hands-on proficiency in Ab Initio, Apache Spark and PySpark, Apache Airflow, Databricks, Delta Lake, Kafka, Teradata, and Python.

Experienced in leading global onsite and offshore delivery teams of up to 15 engineers, driving data governance, data quality, and SLA compliance across complex multi-workstream programmes. Open to senior data engineering, data platform, and delivery leadership roles in Pune or remote.

Senior Data Engineer - Discover Financial Services - USA

(2022-12 - 2026-05)

Fortune 500 credit card and banking client. Platforms: AWS, Teradata, Snowflake, Ab Initio.

• Led end-to-end delivery of Ab Initio and Snowflake-based ETL and ELT pipelines on AWS, processing over 5TB of data daily across card and lending platforms, achieving a 40% reduction in pipeline processing time and improving overall data availability for downstream analytics.
• Architected and optimised scalable batch and real-time data pipelines on AWS (S3, Lambda, EC2, Glue, EMR) supporting credit card transaction processing, fraud detection analytics, and lending risk models.
• Designed and implemented data governance frameworks, data quality controls, and SLA compliance monitoring across multiple concurrent enterprise data workstreams.
• Managed and mentored a cross-functional team of 8 engineers across onsite and offshore locations, overseeing Agile sprint planning, backlog grooming, code reviews, and stakeholder reporting.
• Partnered with business, technology, and risk stakeholders to translate complex data requirements into scalable platform solutions, maintaining high delivery predictability and client satisfaction throughout the engagement.

System Analyst - Atos Syntel - USA

(2021-09 - 2022-11)

Contractor for Allstate Insurance and FedEx. Enterprise data platform modernisation across insurance and logistics verticals.

• Led Allstate insurance data platform modernisation initiative, migrating legacy mainframe ETL workloads to Ab Initio-based cloud-native pipelines, increasing end-to-end automation by 40% and reducing nightly batch processing windows by 30%.
• Directed enterprise data warehouse migration from Teradata to Microsoft Azure for FedEx Services, achieving 50 to 60% automation of data pipelines and reducing on-premises infrastructure footprint by 35% through cloud-native re-architecture.
• Designed reusable cloud ETL framework templates using Ab Initio, Apache Spark, Teradata, and Azure Data Factory, cutting new pipeline development effort by 25% across insurance and retail programmes.
• Managed SLA compliance, delivery quality assurance, cross-team dependency resolution, and a delivery team of 10 engineers across onsite and offshore locations.

Associate Technology Consultant - Bitwise Inc. - USA

(2015-01 - 2021-08)

Contractor for Discover Financial Services. Ab Initio ETL delivery across Teradata-to-Hadoop and Teradata-to-Snowflake cloud migration programmes.

• Delivered Ab Initio ETL pipelines supporting large-scale migrations from Teradata to Hadoop and subsequently to Snowflake, enabling cloud-native data warehouse consolidation and reducing legacy platform dependency.
• Led end-to-end Agile delivery including sprint planning, backlog grooming, release management, and change management coordination for a team of 15 engineers across multiple concurrent programmes.
• Partnered with business stakeholders and data architects for requirements gathering, data mapping, integration testing, and seamless production deployments with zero critical incidents.
• Drove proactive stakeholder communication, delivery status reporting, and risk escalation, consistently maintaining high satisfaction scores across a 6-year engagement.

Systems Analyst | Consultant | Programmer Analyst | Programmer - Earlier Experience

(2008 - 2015)

Progressive roles in ETL development, Teradata and Ab Initio delivery, data warehousing, and client engagement across banking and financial services.

• Systems Analyst (2014 - 2015)
• Consultant (2012 - 2014)
• Programmer Analyst (2010 - 2012)
• Programmer (2008 - 2010)

Bachelor of Engineering - Computer Science - Shivaji University (2007)