Associate Manager – Data & AI Engineering at Accenture (2017-04 – Present)
- Designed and optimized scalable ETL pipelines with PySpark and Databricks Delta Live Tables, ensuring resilient, high-throughput data processing across batch workloads.
- Integrated Generative AI into data workflows — built RAG-based document Q&A systems using LangChain + AWS Bedrock (Claude/Titan models) and vector stores, with Amazon S3 Vectors for semantic retrieval, deployed on AWS Lambda and ECS.
- Implemented Databricks Unity Catalog for centralized governance, lineage tracking, and fine-grained access control across lakehouse environments.
- Led implementation of Informatica EDC and Axon to build comprehensive data governance incorporating automated validation and quality controls.
- Configured row-level and column-level security for GDPR-compliant data access in Unity Catalog and Snowflake.
- Designed REST API services integrated with backend databases using FastAPI; built high-performance web applications ensuring scalability and interoperability.
- Partnered with DevOps to design deployment and monitoring strategies for Spark and Databricks applications.
- Provided technical guidance and mentorship to junior developers, fostering a culture of quality and adherence to architectural best practices.
Senior Consultant – Data Engineering at Capgemini India (2014-10 – 2017-03)
- Designed and built data lake pipelines on AWS using S3, Glue, and Athena, handling both batch and real-time data.
- Managed end-to-end ETL pipelines for financial and customer analytics platforms.
- Led data governance implementation using Informatica AXON and EDC.
- Optimized PySpark jobs, improving pipeline efficiency by 40%.
Software Engineer at Intelliswift Software India Pvt. Ltd (2013-05 – 2014-10)
- Led front-end and back-end development of large-scale multilingual, multisite Drupal CMS websites including theming and performance tuning.
Software Engineer at DNS Education Pvt. Ltd (2011-05 – 2013-05)
- Developed robust web applications with a focus on scalability, proactively improving performance through strategic enhancements and bug resolution.