
Madhumitha M
Data Engineer | Databricks | PySpark | SQL | ETL Pipelines
Hire this person
Send a job offer directly to this candidate
About
Data Engineer with 3 years of experience at Tata Consultancy Services (TCS) in developing and maintaining Databricks ETL pipelines using PySpark and SQL. Skilled in data ingestion, transformation, cleansing, validation, production troubleshooting, and DEV-to-PROD deployments. Experienced in collaborating with cross-functional teams to deliver reliable datasets for analytics and business reporting. Familiar with Agile/Scrum practices and production data workflow monitoring.
Experience
Data Analyst (Data Engineering & BI Development) at Tata Consultancy Services (TCS) (2024-02 – Present)
- Design, code, schedule, and maintain Databricks ETL pipelines (PySpark, SQL) that extract, cleanse, validate, and transform source data into reliable, scalable datasets for Provisioning, Fulfillment, and Promotions reporting.
- Developed and scheduled daily data ingestion jobs in Databricks so downstream Tableau and Power BI dashboards run on current, dependable data.
- Collaborate with cross-functional teams, stakeholders, BI developers, and data engineers to gather and analyze requirements, define KPI logic, and align data components with evolving business needs.
- Enhance and maintain existing pipelines and data components to improve performance and reliability, validating data across source systems to keep published metrics accurate.
- Troubleshoot and resolve production issues in pipelines and data, tracing source-to-report data flow to identify root causes and maintain platform reliability.
- Coordinate DEV-to-PROD deployment of data pipelines and dashboards using Git, Jenkins, and related release tooling, planning releases to minimize disruption to production reporting.
- Design, publish, and maintain 25 interactive Tableau dashboards for order management and KPI monitoring on top of the engineered datasets; delivered 8 dashboards within a single sprint, earning client appreciation.
- Automated daily pipeline and dashboard status updates to Microsoft Teams using Power Automate, improving team visibility of data and reporting health.
- Develop and maintain additional analytical dashboards in Power BI and ThoughtSpot alongside Tableau.
- Participate actively in Agile/Scrum ceremonies, including sprint planning and progress tracking, and contribute to team discussions and deliverable coordination.
Education
Bachelor of Engineering – Bannari Amman Institute of Technology (2019 – 2023)
