Skip to main content
Madhumitha M

Madhumitha M

Data Engineer | Databricks | PySpark | SQL | ETL Pipelines

Talent
ChennaiMember since November 9, 2026
PySparkETL pipelinesPythonSQLAgileScrumsprint planningGitJenkinsPower AutomatePower BIThoughtSpot
·

Hire this person

Send a job offer directly to this candidate

PySparkETL pipelinesPythonSQLAgile

About

Data Engineer with 3 years of experience at Tata Consultancy Services (TCS) in developing and maintaining Databricks ETL pipelines using PySpark and SQL. Skilled in data ingestion, transformation, cleansing, validation, production troubleshooting, and DEV-to-PROD deployments. Experienced in collaborating with cross-functional teams to deliver reliable datasets for analytics and business reporting. Familiar with Agile/Scrum practices and production data workflow monitoring.

Experience

Data Analyst (Data Engineering & BI Development) at Tata Consultancy Services (TCS) (2024-02 – Present)

  • Design, code, schedule, and maintain Databricks ETL pipelines (PySpark, SQL) that extract, cleanse, validate, and transform source data into reliable, scalable datasets for Provisioning, Fulfillment, and Promotions reporting.
  • Developed and scheduled daily data ingestion jobs in Databricks so downstream Tableau and Power BI dashboards run on current, dependable data.
  • Collaborate with cross-functional teams, stakeholders, BI developers, and data engineers to gather and analyze requirements, define KPI logic, and align data components with evolving business needs.
  • Enhance and maintain existing pipelines and data components to improve performance and reliability, validating data across source systems to keep published metrics accurate.
  • Troubleshoot and resolve production issues in pipelines and data, tracing source-to-report data flow to identify root causes and maintain platform reliability.
  • Coordinate DEV-to-PROD deployment of data pipelines and dashboards using Git, Jenkins, and related release tooling, planning releases to minimize disruption to production reporting.
  • Design, publish, and maintain 25 interactive Tableau dashboards for order management and KPI monitoring on top of the engineered datasets; delivered 8 dashboards within a single sprint, earning client appreciation.
  • Automated daily pipeline and dashboard status updates to Microsoft Teams using Power Automate, improving team visibility of data and reporting health.
  • Develop and maintain additional analytical dashboards in Power BI and ThoughtSpot alongside Tableau.
  • Participate actively in Agile/Scrum ceremonies, including sprint planning and progress tracking, and contribute to team discussions and deliverable coordination.

Education

Bachelor of Engineering – Bannari Amman Institute of Technology (2019 – 2023)

Skills

Data EngineerDatabricksPySparkSQLETL Pipelines

Reviews

Related