Shubham Setia

Data Engineer with 5+ years of experience designing, building, and optimizing enterprise-scale data platforms and ETL/ELT pipelines for financial services. Proven expertise in Python, SQL, Snowflake, AWS, and data warehousing, with hands-on experience processing millions of transactions and modernizing large-scale financial data platforms. Skilled in incremental data processing, dimensional modeling, data migration, performance optimization, and data quality, with a strong track record of delivering scalable and reliable data solutions for business-critical analytics and reporting.

Data Engineer – 3 at Fidelity International (2025-04 – Present)

Enterprise Revenue Data Onboarding Platform

• Designed and implemented scalable ETL/ELT pipelines on Snowflake for migrating/onboarding financial revenue data from third party source Purefact using Snowflake, Python, SQL, AWS S3 and SnapLogic, supporting workloads involving millions of transactions.
• Developed scalable processing logic to handle millions of transactions while performing on-the-fly adjustments to ensure accurate revenue closure.
• Optimized Snowflake stored procedures and complex SQL queries for high-volume financial datasets, implementing clustering strategies that reduced processing costs by 35%, and significantly improved job throughput.
• Implemented Change Data Capture (CDC) using Snowflake Pipes, Streams, Tasks, Dynamic Tables and Stored Procedures to support incremental processing, orchestration and automated transformations during Oracle-to-Snowflake migration, while leveraging Zero-Copy Cloning for migration validation and testing.
• Designed and implemented an SCD Type 2 dimension for daily FX rates, maintaining historical versions and effective-date based tracking of exchange-rate changes.
• Built hands-on data transformation workflows using PySpark DataFrames, Spark SQL, joins, aggregations, window functions and partition-based processing.
• Designed the backend OAS RPD data model and KPI reporting for Revenue, Sales and Assets.

Data Engineer – 2 at Fidelity International (2024-01 – 2025-03)

Generative AI Powered Financial Commentary Platform

• Developed a Python-based Generative AI application to process financial datasets and generate automated commentary on trends, patterns, and key financial metrics for business stakeholders.
• Integrated OpenAI APIs and embedding APIs to incorporate financial context and generate relevant insights and data-driven commentary from structured financial metrics.
• Built data processing workflows using Python and Snowflake to ingest, transform, and prepare financial data for downstream GenAI-based commentary generation.
• Containerized and deployed the application using Docker on AWS ECS, leveraging S3, SageMaker, ECR and GitHub for scalable deployment and supporting infrastructure.

Data Engineer – 1 at Fidelity International (2022-09 – 2023-12)

Enterprise Invoice Processing & Payment Analytics Platform for POT

• Developed an end-to-end P2P payment analytics platform to track invoice lifecycle, identify payment bottlenecks, and improve vendor Payment on Time (POT).
• Performed data cleaning, processing and analysis using Python, Pandas and NumPy, with Matplotlib and Plotly visualizations for monitoring payment trends and operational performance.
• Built an interactive Streamlit dashboard that enabled invoice-level tracking and contributed to improving Payment on Time from 65% to 95%.

Graduate Engineer at Fidelity International (2021-09 – 2022-08)

Finance Automation

• Developed a Python utility for source-data availability checks, including weekend/holiday handling and data roll-forward logic.
• Designed OBIEE data models and created reports, analysis and health-check dashboards.
• Build hands-on Databricks workflows with Delta Lake, incremental processing, notebooks, clusters and data engineering pipelines.

Bachelor of Technology in Electronics and Communication Engineering – Deenbandhu Chhotu Ram University of Science and Technology (2017-08 – 2021-07)

Higher Secondary Education – Gopal Vidya Mandir Sr. Sec. School, Jind, Haryana (2014-03 – 2016-04)