Sumit Singh

Data Engineer with ~1.5 years of hands-on experience building and maintaining scalable data pipelines, data warehouses, and cloud-native data infrastructure across AWS and GCP. Proficient in Python, PySpark, SQL, and SparkSQL with proven expertise in ETL/ELT development, data warehousing, workflow orchestration via Apache Airflow, and CI/CD-aligned delivery practices. Experienced in AWS services (S3, Glue, Lambda, EMR, Redshift, Athena), cloud security fundamentals (IAM, access control), infrastructure automation, and version control (Git).

Adept at collaborating across cross-functional teams in Agile environments to deliver accurate, accessible, and secure data solutions. Certified AWS Solutions Architect Associate and GCP Professional Data Engineer — aligned with Barclays' mission of harnessing technology to drive financial innovation.

Framework Engineer (Data Engineering) - Quantiphi Analytics Solutions Pvt. Ltd.

(2025-07)

• Design and build scalable data pipelines and ETL/ELT workflows on AWS (Glue, Lambda, S3, EMR, Redshift) and GCP (BigQuery, Dataproc), ensuring accurate, accessible, and compliant data delivery across production systems — directly aligned with Barclays' data engineering mandate.
• Implement cloud security best practices including IAM policies and data access control mechanisms, ensuring governance and compliance across multi-cloud data infrastructure.
• Orchestrate complex pipeline workflows using Apache Airflow DAGs with automated scheduling, dependency management, alerting, and retry logic for mission-critical data processes.
• Apply CI/CD-aligned engineering practices — version control via Git, automated testing, and deployment standards — ensuring maintainable and production-ready codebases.
• Monitor, troubleshoot, and optimise data pipelines proactively, leveraging logging and alerting mechanisms to minimise downtime and ensure data consistency for downstream consumers.
• Collaborate with cross-functional technology teams in Agile/Scrum cycles to gather requirements, deliver pipeline solutions, and communicate complex data issues to stakeholders effectively.
• Design and implement data quality validation, schema evolution, and partitioned storage optimisation to ensure reliability and integrity of data served to analytics and reporting teams.

Data Engineer Intern - Quantiphi Analytics Solutions Pvt. Ltd.

(2025-01 - 2025-06)

• Built an end-to-end multi-cloud ETL pipeline (S3 → Snowflake → GCS → BigQuery) orchestrated via Apache Airflow, using Python and SQL to automate data extraction, transformation, and loading across large datasets.
• Developed and applied data quality validation checks and performance-optimised SQL transformations to ensure accuracy, completeness, and consistency of data across warehouse targets.
• Authored comprehensive pipeline architecture documentation and best-practice guides, adopted team-wide to standardise ETL workflows and reduce engineer onboarding time.

Subject Matter Expert (Freelance) - Chegg India Pvt. Ltd.

(2023-10 - 2024-12)

• Delivered expert guidance on Python, Data Structures & Algorithms, and Statistics — strengthening scripting, problem-solving, and analytical skills directly applicable to data engineering.

B.Tech - Computer Science and Engineering - Lovely Professional University (2021 - 2025)

Intermediate - PCM - Birla School (2020 - 2020)

Matriculation - Class X - Vivekanand Sr. Sec. School (2018 - 2018)