Sunandita Bhowmik

Data Engineer with 3 years of experience and total 5 years in the Life Sciences, designing and optimizing scalable data solutions on Azure Databricks. Expertise in building data workflows and notebooks using PySpark and Spark SQL to support ETL and ELT processes in cloud-based data lake environments. Strong background in Medallion Architecture, and Delta Lake, enabling high-performance data pipelines and analytics-ready datasets.

Proven ability to improve data processing performance, ensure data quality, and collaborate with cross-functional teams to deliver business-driven insights.

System Engineer, Data Engineer at Tata Consultancy Services (2023-03 – Present)

Data Engineer specializing in building ETL pipelines using PySpark and Azure Databricks with Medallion Architecture implementation for Life Sciences datasets.

• Built ETL pipelines using PySpark and Azure Databricks Notebooks implementing a Medallion Architecture (Bronze, Silver, Gold) to streamline the ingestion of structured and semi-structured Life Sciences datasets.
• Designed end-to-end data pipelines using Azure data Factory (ADF) to extract, transform, and load manufacturing records, producing analytics datasets used by 10+ engineering and business teams.
• Developed data ingestion and transformation pipelines using PySpark and Azure Databricks Notebooks to ingest, transform, and load data from various sources into the data lake.
• Implemented automated data validation frameworks that cut validation execution time by 40%, significantly cutting pipeline delays and boosting processing efficiency at scale.
• Converted 60+ complex business rules into PySpark transformation logic, covering 100% of requirements coverage across all assigned pipeline modules, improving data accuracy.
• Monitored and optimize data processing performance, identifying, and resolving bottlenecks.
• Collaborated with data scientists, analysts, and stakeholders to meet data quality and healthcare compliance standards, lowering data defects.
• Excelled in problem-solving and critical thinking by rapidly evaluating and implementing emerging technologies, reducing project timelines by 30%.
• Performed data validation to deliver consistent data and meet response time requirements for downstream applications.

System Engineer, Quality Engineer at Tata Consultancy Services (2021-04 – 2023-02)

Quality Engineer responsible for data quality verification and compliance with regulatory standards during data handling and migration.

• Verified compliance with Core Data Protection and Life Sciences regulatory standards during data handling and migration.
• Conducted end-to-end data quality checks for major releases (110+ scripts), directly supporting the reliable operation of critical systems.
• Delivered projects on time 98% of the time through diligence, strong interpersonal skills, and clear communication.

B. Tech in Electronics and Communication Engineering – MAKAUT, West Bengal

Senior Secondary in CBSE – Vivekananda Mission High School