Senior Data Engineer at Ingram Micro SSC Pvt Ltd. (2024-05 – Present)
Designed and operated scalable ETL/ELT pipelines, built data quality frameworks, and implemented cloud-native data solutions on GCP and AlloyDB.
- Designed and operated 5+ scalable ETL/ELT pipelines using Python, Java, PostgreSQL and GCP, processing billions of records per month
- Built onboarding and data quality frameworks enabling 3X faster onboarding and delivering 99% accuracy
- Developed observability dashboards using datadog and improving uptime by enabling alerts
- Designed and implemented a domain-specific purpose-built data store on AlloyDb datalake, improving data accessibility and enabling faster analytical queries for downstream teams
- Migrated legacy VM-hosted applications to containerized workloads using Docker and Google Kubernetes Engine (GKE), improving scalability, deployment automation, and infrastructure reliability
- Built real-time data replication pipelines from SQL Server to Pubsub, ensuring near real-time synchronization. Developed health-check dashboards to monitor replication latency, data freshness, and failure metrics
System Engineer at Tata Consultancy Services Ltd. (2020-09 – 2024-05)
Architected and implemented end-to-end data transformation solutions on GCP, designing batch and streaming pipelines and migrating legacy systems to cloud-based solutions.
- Architected and implemented end-to-end data transformation solutions on GCP, designing batch and streaming pipelines using Cloud Storage, BigQuery, Cloud SQL, Compute Engine, and Pub/Sub, enabling scalable and cloud-native data processing
- Deepened understanding of on-premises architecture to seamlessly transition to cloud-based solutions
- Designed and implemented API views, working closely with clients to replicate existing logic in the cloud environment
