Chandra Venkata Naveen

Azure Data Engineer with 3.2 years of experience designing, developing, and optimizing scalable ETL/ELT pipelines using Azure Data Factory (ADF), Azure Databricks, PySpark, SQL, and Python. Experienced in building batch and incremental ingestion pipelines from SQL Server, REST APIs, CSV, and JSON into Azure Data Lake Storage Gen2 (ADLS Gen2). Hands-on experience implementing Medallion Architecture, Delta Lake, reusable Databricks notebooks, Spark performance tuning, and production-grade data processing.

Skilled in CI/CD deployments, production support, incident resolution, root cause analysis (RCA), and Agile software delivery. Proven ability to build reliable Azure data platforms that support enterprise analytics and reporting.

Azure Data Engineer at HCLTech (2022-09 – 2025-11)

Client: HP. Project: Retail Customer Segmentation & Analytics Platform. Environment: Azure Data Factory | Azure Databricks | PySpark | SQL | Python | ADLS Gen2 | Delta Lake | SQL Server | REST API | CSV | JSON

• Designed and developed enterprise-scale ETL/ELT pipelines using Azure Data Factory, Azure Databricks, PySpark, SQL, and Python.
• Built batch and incremental ingestion frameworks from SQL Server, REST APIs, CSV, and JSON into Azure Data Lake Storage Gen2.
• Developed reusable Databricks notebooks implementing Medallion Architecture (Bronze, Silver, Gold).
• Implemented Delta Lake features including MERGE, OPTIMIZE, VACUUM, and ZORDER to improve reliability and query performance.
• Optimized Spark workloads using partitioning, caching, broadcast joins, and query tuning, reducing processing time by approximately 60%.
• Created parameterized Azure Data Factory pipelines with dynamic content and reusable orchestration components.
• Developed SQL transformation, validation, and reconciliation logic to ensure high-quality data delivery.
• Implemented incremental loading strategies for efficient daily processing.
• Participated in CI/CD deployments and Git-based version control.
• Monitored production pipelines, performed RCA, and resolved incidents within SLA.
• Collaborated with business analysts, QA teams, and stakeholders in Agile environments.

Bachelor of Engineering in Computer Science & Engineering – Andhra University (2018 – 2022)