Om Jay Mishra

Data Engineer with 3+ years building scalable Lakehouse architectures on Azure Databricks. Reduced pipeline runtime from 6 hours to 30 minutes on 500M+ record datasets using Liquid Clustering, improved query performance 65% across 50M+ records, and cut Databricks DBU costs 25% through cluster and autoscaling optimization.

Databricks Certified Data Engineer

Associate with deep expertise in PySpark, Delta Lake, Unity Catalog, and Medallion Architecture. Immediately available.

Data Engineer at Azimuth GRC (2023-05 – 2026-05)

• Led end-to-end migration from legacy databases to Databricks Lakehouse, transforming SQL-based workflows into scalable PySpark and Delta Lake architectures
• Resolved partition skew on 500M+ record pipelines using Liquid Clustering, reducing runtime from 6 hours to 30 minutes
• Developed a Gold-layer Star Schema in Databricks, improving query performance by 65% across 50M+ records
• Reduced Databricks DBU consumption by 25% through cluster optimization, autoscaling, and Photon Engine utilization
• Orchestrated Azure Data Factory and Databricks pipelines with custom Python automation, eliminating 270+ hours of manual effort
• Implemented centralized data governance in Unity Catalog with fine-grained access controls and automated audit tracking

Data Analytics Engineer at PlanetSpark (2022-11 – 2023-05)

• Automated data transformation workflows for 10K+ student records using Google Apps Script, improving data preparation efficiency
• Performed data cleansing, validation, and transformation to improve dataset accuracy and reporting reliability
• Consolidated multi-source data into a centralized Power BI reporting layer, enabling stakeholders to track engagement and enrolment metrics

B.Tech in Mechanical & Automation Engineering – Maharaja Agrasen Institute of Technology (2019 – 2023)