Skip to main content
Apurva Dalvi

Apurva Dalvi

Data Engineer | ETL/ELT Pipeline Development | Data Quality & Data Integration | BI Dashboarding

Talent
SheffieldMember since July 9, 2026
Data EngineerPythonSQLPySparkData ModellingCurated DatasetsETL DevelopmentData ValidationData Quality EngineeringData TransformationSnowflakedbtApache AirflowAWSAzureMedallion ArchitectureSQL ServerMongoDBMySQLRelational Database DesignSQL ViewsStored ProceduresQuery OptimisationGitBitbucketJenkinsCI/CDCode ReviewsTechnical DocumentationTesting
·

Hire this person

Send a job offer directly to this candidate

Data EngineerPythonSQLPySparkData Modelling

About

Governance Structure Analysis: Reviewing board structure and departmental operating model for an Indonesia-based NGO (Mitra Wacana) as part of a 7-person consulting team, identifying ambiguity in board-level decision rights.

Documentation & Tracking: Producing structured documentation — 3 reports/logs to date — capturing meeting minutes, action items and clarification requests to maintain traceability ahead of stakeholder engagement.

Experience

Consultant Intern - Blackmont Consulting

(2026-05)

  • Governance Structure Analysis: Reviewing board structure and departmental operating model for an Indonesia-based NGO (Mitra Wacana) as part of a 7-person consulting team, identifying ambiguity in board-level decision rights.
  • Documentation & Tracking: Producing structured documentation — 3 reports/logs to date — capturing meeting minutes, action items and clarification requests to maintain traceability ahead of stakeholder engagement.

Data Engineer - Decimal Point Analytics Pvt Ltd

(2021-08 - 2023-05)

  • ETL Pipeline Development: Built end-to-end pipeline in Python, SQL and AWS, ingesting 120K+ daily data points from 50+ external sources into SQL reporting layers for analytical consumption.
  • Root-Cause Analysis: Diagnosed recurring data inconsistencies across daily ingestion and reporting layers spanning 50+ external sources, identifying the validation gaps that informed the exception-reporting framework built below.
  • Data Validation Framework: Built pre-ingestion checks for duplicates, completeness and anomalies, reducing incoming data quality issues by 90% and preventing recurrence of historical data defects.
  • Exception Reporting & Validation: Automated manual cross-checking of 120K+ daily records against source databases, prior records and external source data, building an exception-report workflow that saved ~2-3 hours per analyst per report.
  • Historical Data Remediation: Cleansed 30+ years of data in phased iterations, remediating inconsistencies and improving annual reporting and dashboard KPI accuracy.
  • BI Semantic Layer: Built Power BI reporting layer using SQL pre-aggregations, Power Query transformations and DAX, powering client-facing financial ratio and NAV time-series reporting.
  • Dashboard Data Integrity Fix: Resolved field-mapping and schema misalignment causing inaccurate client-facing dashboards, restoring data integrity across SQL Server, MongoDB and API sources.
  • Query Performance Tuning: Optimised SQL-based reporting queries via indexing, join refinement and execution plan tuning, resolving recurring timeout failures and improving performance by 30%.
  • Codebase Refactor: Refactored 500+ ingestion scripts into modular functions with structured exception logging, cutting debugging effort and speeding up onboarding of new data sources.
  • Pipeline Operations: Managed 40+ scheduled batch data workflows on AWS EC2, investigating failures through logs and adjusting schedules to ensure pipeline reliability.
  • CI/CD Integration: Configured server environment paths enabling Jenkins-based CI/CD automation across ingestion workflows, supporting the shift from manual to standardised deployment testing.
  • Team Development: Mentored 3 junior engineers via code reviews and technical coaching; delivered Python training workshops to build capability across the wider team.

Data Analyst - Bhaktivedanta Hospital and Research Institute

(2019-06 - 2019-07)

  • Data Validation: Extracted 3 months of SQL Server data for quarterly reporting, validating against departmental records using Excel to resolve inconsistencies in performance metrics.
  • OPD Dashboard Development: Built Power BI dashboards with DAX-based KPIs — patient footfall, repeat visits and OPD-to-IPD conversion rates — for Outpatient department performance monitoring.
  • Stakeholder Collaboration: Partnered with 3 stakeholders — the data lead and Outpatient department leadership — through requirement-gathering sessions to define and refine 10 dashboard KPIs.
  • Data Governance: Ensured compliant handling of 6 months of sensitive healthcare data under hospital information-governance protocols and IT Act 2000 data-protection provisions, across SQL extraction and Power BI workflows.

Education

MSc - Data Science - University of Sheffield, United Kingdom (2023-09 - 2024-11)

Skills

Data EngineerETL/ELT Pipeline DevelopmentData Quality & Data IntegrationBI Dashboarding

Reviews

Related