Saurabh Mehta
Sr Lead Data Engineer | Expert in ETL pipelines | Database Design | Cloud Solutions
Hire this person
Send a job offer directly to this candidate
About
Established Data Engineering leader with 18+ years of experience designing end-to-end scalable data pipelines, architecting enterprise data platforms, and delivering high-performance data solutions across Azure, AWS, Snowflake, Informatica, Oracle, SQL Server, and PostgreSQL. Proven foundational knowledge in designing, building, and optimizing end-to-end data pipelines using PySpark, Databricks SQL, and the Medallion Architecture. Expert in advanced SQL, ETL development, Python, Spark, and distributed data processing.
Proven ability to build scalable ingestion frameworks, automate data quality and reconciliation workflows. Strong background in schema design, performance tuning, and multi-platform pipeline orchestration using AWS Glue, AWS Batch, Spark, Azure Data Factory, Informatica, and SQL-driven transformations. Experienced technical leader skilled at partnering with stakeholders, defining data architecture standards, and driving best practices across engineering teams.
Experience
Software Engineer at Ved Software Services Inc.@Gartner Inc. (2022-09 – Present)
- Architected end-to-end cloud-native ingestion/orchestration pipelines using Python, Terraform, Docker, AWS Batch and AWS Glue(Spark), enabling scalable ingestion from PostgreSQL to Oracle.
- Formulated multi-system gap analysis and automated data-reconciliation reports using Python, AWS Glue, PostgreSQL, Oracle SQL, Salesforce SOQL, improving data accuracy by ~ 90%.
- Executed data migration for Salesforce datasets using Data Loader, Workbench, and CLI Data Loader, ensuring accuracy and performance.
- Overhauled complex Tableau CRM workflows into optimized PostgreSQL stored procedures and functions.
- Developed advanced PL/SQL/T-SQL assets (cursors, triggers, packages, dynamic SQL) and optimized queries, achieving up to 60% faster execution via indexing and design changes.
- Pioneered data-chunking and parallel processing strategies, reducing bulk update times by 70% for large-scale datasets (~10M records), driving faster turnaround for enterprise projects.
- Led Oracle to SQL Server migration; redesigning schema, datatype mappings, and performance-optimized structures.
- Conducted deep data profiling and analysis using complex SQL queries across Oracle and SQL Server, identifying integration issues and delivering robust solutions.
- Provided technical leadership on data modeling, ETL best practices, and SQL optimization across teams.
- Identified performance bottlenecks, implemented fixes, and delivered complex business requirements with rigorous troubleshooting.
Manager at Gartner Inc. (2021-10 – 2022-08)
- Led an 8-member engineering team; driving architecture decisions, performance tuning and delivery strategy.
- Directed Oracle to Microsoft SQL Server migration, including PL/SQL to T-SQL conversion and schema redesign.
- Engineered scalable ADF pipelines to ingest millions of rows from Azure Synapse and Oracle into Azure SQL MI, deploying hybrid full and incremental-load logic to minimize processing windows.
- Achieved ~50% reduction in SQL execution time through systematic tuning (Explain Plan, SQL Profiler, Tkprof).
- Drove decisions on database design and migration strategy; administered workload and development priorities.
- Acted as a data quality champion, identifying issues and coordinating with system owners for rapid resolution.
Lead Software Engineer at Gartner Inc. (2021-04 – 2021-09)
- Converted Power BI AL logic into optimized PL/SQL implementations for analytics workloads.
- Coordinated with management and partner teams on application design status, project pipeline, and platform health.
- Collaborated with Data Science and BI teams to deliver KPI-driven data solutions.
- Built complex SQL/PL-SQL assets under Agile practices and mentored peers on query quality and optimization
Senior Software Engineer at Gartner Inc. (2016-06 – 2021-03)
- Led Research Board data migration from Salesforce to Siebel CRM.
- Built complex SWR reports (SQL, PL/SQL, dynamic SQL), HTML email templates, and batch data loads via SQL*Loader.
- Delivered data extraction/transformation from Oracle to flat files for SugarCRM loading; collaborated with SugarCRM on advanced MySQL queries.
- Conducted data Integration/migration from various applications to Siebel CRM using EIM.
Assistant Consultant at Tata Consultancy Services (2013-09 – 2016-06)
- Architected and deployed a programmatic Data Quality Metrics (DQM) framework leveraging T-SQL and Batch scripts to automate governance, profiling, and anomaly detection across core databases.
- Designed and implemented complex ETL mappings using Informatica PowerCenter, SQL, PL/SQL, SQL Loader, Unix Shell Scripts from heterogeneous sources (Oracle, Flat Files, Netezza) into an Operational Data Store.
- Managed a 10-member team; delivered estimates, pricing, and RFP responses.
IT Analyst at Tata Consultancy Services (2010-11 – 2013-08)
- Developed complex SQL queries, enhancements/defect fixes on the PL/SQL code using cursors, triggers, packages, dynamic SQL & UNIX Shell Scripts.
- Liaised with customers, other team to better understand customer needs and recommend appropriate solutions.
Assistant Systems Engineer at Tata Consultancy Services (2007-05 – 2010-10)
- Built PL/SQL jobs, batch loads via SQL*Loader, and UNIX Shell scripts; performed data analysis/profiling to resolve data issues.
- Configured Tariff & Rate Plans on telecom billing tools (IRB 3.0/Kenan) and integrated billing system with downstream systems (CRM SAP, VoIP).
Education
B. Tech. in Electronics & Communication Engineering – Institute of Engineering & Technology (aff. Punjab Technical University, Jalandhar) (2002 – 2006)