Divyansh Kumar

Data Engineer with 3+ of experience in analytics and data engineering, specializing in building scalable batch and streaming data pipelines using Azure Databricks, PySpark, SQL, and Delta Lake. Experienced in designing Medallion Architecture solutions, implementing real-time data ingestion using Azure Event Hubs (Kafka API), and developing data quality frameworks with Delta Live Tables (DLT). Skilled in data modeling ETL/ELT development, performance optimization, and delivering reliable analytics-ready datasets for business intelligence and reporting.

Data Associate at Amazon (2020-09 – 2025-11)

• Engineered automated data validation pipelines processing across 5 source systems, maintaining 99%+ data accuracy for KPI dashboards.
• Maintained and optimised ADF pipelines for source-to-target data movement including incremental loads, rerun management and execution monitoring.
• Executed complex SQL queries for data validation, reconciliation and trend analysis on large structured datasets consumed by Power BI dashboards and business stakeholders.
• Developed PySpark transformation notebooks in Azure Databricks implementing Medallion architecture for data cleansing, deduplication and schema standardisation.
• Investigated data issues such as missing records, duplicate prices and delayed updates by tracing problems to source tables and ingestion workflows.
• Collaborated closely with analytics and data engineering teams to troubleshoot pipeline failures and resolve data quality issues impacting business KPIs.

B.Tech in EEE – INDERPRASTHA ENGINEERING COLLEGE AKTU (2015 – 2019)

Class XII – DAV Public School

Class X – DAV Public School