Senior Data Engineer at Kavtech Solutions (Private) Ltd. (2022-08 – Present)
Senior Data Engineer responsible for designing, optimizing, and maintaining scalable ETL pipelines and cloud-native data solutions.
- Engineered and optimized server-based ETL pipelines using Pentaho Data Integration (PDI), improving data processing performance by 67% (3× faster) through transformation tuning, workflow redesign, and optimized query execution.
- Automated complex data extraction, cleansing, validation, and error-handling tasks—enhancing pipeline reliability and data accuracy across enterprise datasets.
- Implemented Change Data Capture (CDC) frameworks and reusable transformation logic to streamline incremental data loads and reduce operational overhead.
- Developed a custom job scheduling and monitoring framework in Pentaho, improving visibility, reducing downtime, and ensuring SLA adherence.
- Led the migration to AWS Serverless architecture, transforming legacy pipelines into cloud-native solutions using AWS Lambda, Glue, S3, Athena, Redshift, Step Functions, SQS, and CloudWatch.
- Reduced data refresh latency from 30 minutes to 3 minutes (10× faster / 90% improvement), enabling near real-time analytics and faster decision-making.
- Built modular, event-driven ETL orchestration patterns and data quality layers for scalable, cost-efficient data processing.
- Collaborated with cross-functional teams and stakeholders to define data architecture standards, performance SLAs, and cloud cost optimization strategies.
- Mentored junior engineers on AWS best practices, debugging, and performance tuning, fostering a culture of continuous improvement within the data team.
- Leading the development of the product CAMMI, an AI-powered marketing and content intelligence platform that automates strategy creation, content generation, publishing, and performance analytics. Overseeing architecture design, sprint planning, and delivery across AWS-based microservices, LLM integrations and NLP-driven brand knowledge ingestion, ensuring scalable, secure, and real-time data workflows.
Associate Software Engineer at i2c Inc. (2021-01 – 2022-07)
Associate Software Engineer contributing to Performance Security Testing team and collaborating with Data Science teams on ETL pipeline design and optimization.
- Contributed to the Performance Security Testing team, enhancing system scalability and reliability across core enterprise applications.
- Collaborated with Data Science and Business Intelligence teams to design, validate, and optimize data pipelines supporting analytics and reporting use cases.
- Conducted ETL testing and validation for data transitions from source databases and Excel files into the data warehouse (DWH), ensuring high data accuracy and consistency.
- Improved query performance by 35% through SQL tuning and indexing, significantly reducing report generation time.
- Designed and executed comprehensive load, stress, and regression testing using JMeter and JProfiler, proactively identifying performance bottlenecks and improving system throughput.
- Performed validation and functional testing on Power BI and SSRS dashboards, ensuring end-to-end accuracy in analytics delivery.
- Actively participated in Agile sprints, collaborating with product, QA, and engineering teams to streamline defect resolution and improve release quality.
- Logged and tracked defects and change requests (CRs) through JIRA, supporting continuous improvement and audit compliance.
Production Data Analyst at Afiniti (2021-03 – 2021-12)
Production Data Analyst responsible for enterprise-grade production data support and incident resolution for business-critical systems.
- Delivered enterprise-grade production data support, diagnosing and resolving high-priority incidents impacting business-critical systems across multiple clients.
- Performed detailed root cause analysis on recurring data issues, reducing average resolution time by 25% through proactive monitoring and process automation.
- Streamlined incident management workflows using standardized troubleshooting checklists and escalation procedures, improving SLA adherence and client satisfaction.
- Collaborated with data engineering and application teams to implement data validation and quality assurance routines, ensuring data integrity across production environments.
- Recorded and tracked client service requests, change tickets, and resolutions using JIRA and internal support systems, maintaining full audit traceability.
- Partnered with cross-functional teams to prioritize and resolve data-related issues, driving operational stability and continuous improvement.
