Hare Krishana Mishra

DataEngineer with 2 years of experience designing and optimizing scalable data pipelines in Azure environments. Proficient in Python, PySpark, SQL, Azure Databricks, Azure Data Factory, and ADLS Gen2. Experienced in building Lakehouse architectures and incremental ETL workflows to ensure high-performance, reliable, and analytics-ready data solutions.

Data Engineer - AU TECHNOLOGY CONSULTING

(2024-03)

• Designed, developed, and optimized end-to-end data pipelines for analytical and near real-time processing within Azure cloud environments.
• Architected and implemented a scalable Azure Data Lakehouse using ADLS Gen2 and Delta Lake to enable ACID transactions, schema enforcement, and reliable data versioning.
• Built and maintained Bronze, Silver, and Gold data layers to enhance data governance, quality, and analytics readiness.
• Developed incremental ETL pipelines with partitioning strategies to efficiently process large-scale datasets and improve processing performance.
• Engineered high-performance PySpark workflows in Azure Databricks, applying caching, partition pruning, and query optimization techniques.
• Automated and monitored data workflows using Azure Data Factory (ADF), ensuring reliable scheduling, orchestration, and pipeline execution.
• Ingested and transformed structured and semi-structured data from multiple sources including user activity logs, profile datasets, and feedback systems.
• Implemented robust data validation, cleansing, and transformation logic using PySpark, Pandas, and SQL to maintain data integrity and consistency.
• Loaded curated datasets into Delta Lake tables optimized for downstream analytics and reporting.
• Executed complex analytical queries using Databricks SQL to support business intelligence and reporting use cases.
• Optimized storage formats and data schemas to reduce query latency and improve cost efficiency.
• Collaborated with cross-functional analytics teams to design scalable data models aligned with business reporting requirements.

B.Tech - Computer Science and Engineering - Vellore Institute of Technology, Bhopal (2020 - 2024)

Intermediate - PCM, CBSE Board - Tulsi Vidya Niketan, Varanasi (2019 - 2019)

High School - CBSE Board - St. Al-Haneef Educ Centre, Varanasi (2017 - 2017)