Data Engineer - Lingaro - Bengaluru, India
(2024-05 - 2026-03)
- Architected end-to-end Lakehouse pipelines on Azure Databricks using Medallion Architecture (Bronze/Silver/Gold), ingesting data from 10+ heterogeneous sources via ADF into ADLS Gen2, achieving 99.5% pipeline uptime.
- Reduced PySpark job execution time by ~40% through dynamic partitioning, intelligent caching, broadcast join optimizations, and AQE tuning across 15+ production pipelines, directly improving downstream SLA compliance.
- Built fully automated CI/CD pipelines using Azure DevOps (YAML-based), cutting Databricks notebook deployment time from 2 days to under 3 hours and eliminating manual release errors.
- Implemented Unity Catalog for enterprise-wide data governance across 5+ catalogs — enforcing column-level security, row-level access control, automated data lineage tracking, and GDPR compliance for EU client data.
- Designed and orchestrated multi-source data workflows using Apache Airflow (DAGs with retry logic, alerting, and SLA monitoring) and ADF trigger-based pipelines, reducing pipeline failures by 30%.
- Collaborated with data architects and business stakeholders to define data contracts, SLAs, and schema evolution strategies for Delta Lake tables.
Service Support Representative 3 - Unisys - Bengaluru, India
(2024-01 - 2024-04)
- Monitored and maintained production data pipelines and ETL jobs, performing SQL-based data validation and anomaly detection to ensure 100% SLA compliance across critical business systems.
- Resolved P1/P2 data pipeline incidents with average resolution time under 2 hours, preventing downstream reporting failures for key stakeholders.
Data Support Engineer - Tesco - Bengaluru, India
(2023-07 - 2023-12)
- Supported development and maintenance of ETL pipelines processing 5M+ daily records, performing SQL-based data transformation, validation, and quality checks across retail data feeds.
- Monitored pipeline executions on ADF and resolved data quality issues, reducing data reliability incidents by 25% over 6 months.
- Assisted in optimizing data processes for reporting and analytics use cases, cutting average report generation time by 20%.
Data Operations Engineer - Accenture - Bengaluru, India
(2021-09 - 2023-04)
- Supported data ingestion and ETL pipeline operations for enterprise clients, processing structured and semi-structured data using SQL and Python across Azure-hosted environments.
- Performed data transformation, validation, and reconciliation ensuring 99%+ data accuracy for business-critical reporting pipelines.
- Collaborated with cross-functional stakeholders to translate business data requirements into technical pipeline specifications, improving delivery turnaround by 15%.
- Documented data pipelines, data dictionaries, and SOP runbooks, reducing onboarding time for new team members by 30%.
DevOps Engineer - Apponix Technologies - Bengaluru, India
(2022-01 - 2022-09)
- Engineered CI/CD automation pipelines (Jenkins + Docker + Git) that reduced average deployment time by 30%, enabling 3x faster feature delivery across 4 production microservices.
- Monitored and optimized infrastructure performance (CPU, memory, disk I/O), ensuring 99.9% uptime for highly available production systems.
- Implemented centralized logging and infrastructure monitoring (ELK stack), proactively identifying and resolving 10+ recurring system bottlenecks.
Data Analyst - IBM - Bengaluru, India
(2019-03 - 2019-12)
- Analysed large datasets to identify business trends, delivering insights that improved operational decision-making accuracy by 15%.
- Built automated SQL reports and dashboards, reducing manual data retrieval effort by 20% (equivalent to 8 hours/week) for the operations team.
SQL Database Administrator - Bangalore University - Bengaluru, India
(2018-01 - 2018-12)
- Administered SQL databases with focus on performance tuning, indexing strategies, and query optimization, maintaining 99.9% database availability.
- Implemented backup, recovery, and RBAC security strategies, ensuring compliance with institutional data governance policies.