Pittu Harikrishna

Data Engineer with 3+ years of experience designing, optimizing, and testing ETL/ELT pipelines on the Azure Cloud ecosystem using Azure Databricks, Azure Data Factory, ADLS Gen2, PySpark, and Delta Lake. Proven track record processing 50M+ records/day with 99%+ pipeline uptime, a 35% performance improvement, and 30% reduction in manual deployment effort. Skilled in data validation, schema enforcement, reconciliation testing, Medallion Architecture, Unity Catalog governance, Workflow Orchestration, and CI/CD automation across enterprise data platforms.

Data Engineer - Accenture - Bengaluru, India

(2023-09)

Design, optimize, and test ETL/ELT pipelines on Azure Databricks and Azure Data Factory for enterprise data solutions. Develop PySpark transformations, implement data governance and validation frameworks, and automate CI/CD deployment pipelines. Drive performance optimization and maintain 99%+ pipeline reliability.

Data Engineer - Retail Sales ETL Pipeline - Accenture - Bengaluru, India

(2023-09)

Architected scalable 50M+ daily record pipeline using Databricks, Azure Data Factory (Triggers, Data Flows, Copy Activity, Control Flow), and Delta Lake. Achieved 60% reduction in analyst wait time and 40% processing improvement.

• Designed Medallion Architecture with incremental ingestion, Data Flows for ETL transformation, and Delta Lake MERGE for ACID-compliant upserts
• Engineered Azure Data Factory pipelines with Triggers (Schedule, Tumbling Window) and Control Flow, using JSON/YAML-based configuration for reliable multi-step orchestration
• Designed and executed data validation and reconciliation test cases across Bronze, Silver, and Gold layers to ensure defect-free, ACID-compliant upserts
• Optimised PySpark jobs using Spark Adaptive Query Execution, partitioning, caching, and broadcast joins, achieving 35% performance improvement
• Implemented Delta Lake for schema evolution, time-travel support, and transactional integrity across pipeline layers
• Automated monitoring with alert rules and error handling, maintaining 99%+ pipeline uptime with 30% reduction in manual intervention
• Enabled Data Governance with Unity Catalog for access control and schema validation across Bronze, Silver, Gold layers

Data Engineer - Customer Data Platform - Accenture - Bengaluru, India

(2023-09)

Built enterprise-grade data lakehouse standardising 10M+ customer records with zero-defect delivery. Implemented SCD Type 1 & 2, dimensional modeling, and Data Governance frameworks for compliance.

• Designed Data Lakehouse architecture with Medallion pattern, Structured Streaming for real-time ingestion, and Delta Live Tables for automated transformations
• Implemented dimensional models (Star Schema, Snowflake Schema) with SCD Type 1 & 2 for complete audit trails and historical tracking
• Designed and maintained automated validation, deduplication, and schema-enforcement test suites, achieving 25% error reduction in reconciliation
• Deployed Unity Catalog for data governance, enforcing role-based access control across the platform
• Orchestrated complex ETL workflows using SSIS and Databricks with automated validation, deduplication, and schema enforcement
• Sustained 99%+ production uptime across 10+ ETL pipelines with proactive monitoring, regression testing, and performance tuning
• Managed CI/CD deployment pipeline with Git and Azure DevOps for automated testing and cross-environment consistency

Bachelor of Technology (B.Tech) - Electronics & Communication Engineering - Bharath University

Intermediate (12th Grade) - MPC