Data Engineer - Emids Technologies - Bangalore, India
(2022-02)
Data Engineer - Tableau Data Sources Migration - Emids Technologies - Bangalore, India
(2026-04)
- Migrated complex Tableau custom SQL queries from Azure Synapse Analytics (SSMS-based) to Databricks Unity Catalog, ensuring uninterrupted reporting continuity.
- Performed source-to-target validation across migrated datasets and built an automation framework that accepts config files mapping Synapse reference tables to Databricks-equivalent tables.
- Developed a Databricks notebook-based validation engine performing schema validation, column case-sensitivity checks, data aggregation comparison, row-level sampling, and null/mismatch detection.
- Generated HTML-based validation reports to rapidly surface discrepancies and improve team productivity.
- Improved migration accuracy and reduced validation time by over 70% through end-to-end automation.
Data Engineer - Enterprise Event-Driven E-Commerce Data Platform - Emids Technologies - Bangalore, India
(2022-02)
- Designed and developed a metadata-driven data ingestion framework in Azure Databricks to process multiple e-commerce data sources using a single generic ingestion pipeline.
- Implemented Medallion Architecture (Bronze, Silver, Gold) with Unity Catalog and Delta Lake for scalable data processing and governance.
- Built a configuration-driven ingestion framework using metadata tables and centralized schema registry, eliminating duplicate ingestion code for multiple source systems.
- Developed reusable PySpark components for schema enforcement, audit column generation, and dynamic source-to-target mapping.
Data Engineer - Data Modernization Project - Emids Technologies - Bangalore, India
(2022-02)
- Migrated legacy Synapse-based tables and views into Databricks Unity Catalog and redesigned Gold Layer architecture to source fully from Databricks instead of Synapse.
- Performed SQL refactoring and query performance optimization, validating data consistency across legacy and modernized systems to support downstream reporting applications.
