Data Engineer at Tata Consultancy Services (2020-10 – Present)
ETL Databricks Developer at Tata Consultancy Services (2025-01 – Present)
EY FDL 1.25 & 1.5
- Collaborated with stakeholders to gather requirements and understand business requirement.
- Led Metadata setup activity for new stakeholders to enabling efficient data onboarding, improved data discoverability, and governance compliance.
- Developed end-to-end ETL pipelines for new stakeholders, including Databricks notebooks and SQL views, enabling seamless data flow up to the consumption layer.
Databricks Developer at Tata Consultancy Services (2023-04 – 2024-12)
GE Vernova and Aerospace Separation
- Part of end-to-end data separation of GE Vernova and Aerospace business, ensuring accurate domain segregation across all data layers.
- Refactored monolithic ETL logic by splitting a single Databricks notebook into domain-specific pipelines, improving scalability, maintainability, and data isolation.
- Designed and implemented separate metadata, ETL notebooks, workflows, data models, and Apache Airflow DAGs for each domain for both the businesses, ensuring governance and structural consistency.
- Ensured seamless replication and alignment of source contractual data and downstream consumption layers, maintaining data integrity and business continuity.
- Automated manual processes and implemented validation dashboards in Databricks to track data quality metrics.
Data Quality Developer at Tata Consultancy Services (2022-02 – 2023-04)
GE Healthcare Separation from GE Capital
- Executed large-scale data separation of GE Healthcare from GE Capital across 5 data domains, ensuring accurate domain-level segregation.
- Monitored HVR processes to ensure real-time data synchronization across domains.
- Managed end-to-end deployment lifecycle using GitHub, ensuring smooth CI/CD across environments.
- Ensured alignment of metadata, data models, and business rules post-separation for consistent reporting.
- Collaborated with cross-functional teams to resolve data discrepancies and ensure successful delivery of separation milestones.
ETL Developer at Tata Consultancy Services (2020-11 – 2022-01)
Greenplum to Databricks Migration
- Facilitated in large-scale data migration from PostgreSQL to Databricks Spark, managing across 5 GE Finance data domains, ensuring high data integrity and scalability.
- Handled end-to-end ownership for 3 domains, while contributing to additional domains, collaborating with cross-functional teams to resolve data discrepancies.
- Migrated 60+ tables and 35+ views from Greenplum to Databricks using Spark SQL, ensuring seamless data transition across 3 data domains.
- Developed 15+ metadata-driven ETL notebooks and Databricks SQL-based validation dashboards, automating daily data quality checks (counts, duplicates, nulls, aggregates, financial reconciliations).
- Revamped 20+ MemSQL report scripts and procedures for 3 data domains, facilitating end-to-end data delivery for business intelligence reporting and reducing report generation time by 30-40%.
- Orchestrated pipelines using Apache Airflow (AWS), enabling scheduled trigger-based execution of Databricks workflows with improved pipeline reliability.