Venkatnarasimha M
Lead Data Engineer · Data Quality, ETL & Warehousing
Hire this person
Send a job offer directly to this candidate
About
Lead data engineer with 16 years across banking, healthcare and public sector, combining hands-on data engineering and warehousing with deep expertise in data quality, validation and observability. Designs and implements scalable data pipelines and rule-based quality frameworks in Python, PySpark and SQL, models and validates warehouse structures (star schema, dimension/fact, incremental loads), and sets engineering standards across teams. Leads implementation of data-quality and monitoring frameworks — moving beyond basic checks to volumetric, trend and anomaly validation — and drives root-cause analysis and resolution of data incidents.
Works with CI/CD and version-controlled workflows (Jenkins, Git), Unix/Bash shell scripting, and cloud data platforms (Azure and AWS). Acts as a technical point of escalation, mentoring engineers and setting standards for testing, validation and code quality. Currently at PNC Bank, following four and a half years on the bank's AML Analytics Hub leading onshore/offshore teams of up to ten.
Experience
Data Engineer - Incedo Inc.
(2026-02)
Client: PNC Bank — Credit Line Management (CLM) platform. Lead quality engineering for big data applications spanning data ingestion (ARL), workflow orchestration (RLO) and downstream decisioning, across consumer and business card portfolios.
- Build and run rule-based validation and reconciliation checks in PySpark on Databricks to assure large-scale ingestion, transformation and load; embed automated data-quality checks into Jenkins CI/CD pipelines with Git on Azure, verifying integrity on each build and deployment.
- Own test/QE strategy and effort estimation from functional requirements and mapping documents; direct onshore and offshore engineers to agreed standards.
- Verify data quality, lineage and integrity end to end, reconciling upstream sources against downstream output; maintain requirement-to-defect traceability in JIRA and secure formal SIT, UAT and regression sign-off.
Data Engineer, ETL & Reporting - Palnar Inc.
(2025-08 - 2026-02)
Client: Fidelity Health Benefits — employee health & wellness benefits platform.
- Skilled in ETL design, data validation and building pipelines in Python, SQL and PySpark; built automated data-quality checks as rule-based PySpark frameworks in Databricks, integrated into Jenkins CI/CD pipelines with Git for continuous regression coverage.
- Validated ETL across medical, dental, vision and supplemental benefits data from enrolment through claims, writing complex aggregation SQL against Oracle; assured Tableau and Kibana reporting and reconciled high-volume data across heterogeneous systems.
- Produced strategy, plan and summary documentation for SIT and UAT, managing traceability in JIRA.
Senior Data Quality Consultant - CGI Information Systems
(2021-01 - 2025-08)
Client: PNC Bank — AML Analytics Hub (AAH), Big Data Platform. Quality engineering lead on the modernisation of PNC's anti-money-laundering estate onto its Big Data Platform, supporting advanced tuning methodology and machine-learning model management. Delivered the BBVA USA migration following PNC's acquisition of BBVA — a large-scale data-consolidation programme across heterogeneous source systems.
- Developed Python and PySpark automation for data quality frameworks in Databricks, scaling assurance across modules and pipelines; worked with data lakes managing structured and unstructured banking data, and embedded data-quality tests into Jenkins CI/CD pipelines on Azure to automate regression across releases.
- Led a distributed engineering team of ten across onshore and offshore, owning delivery to SLAs and audit protocols; owned QE strategy and traceability in HP ALM with source-to-target validation through every load stage.
- Reconciled large data volumes between heterogeneous systems, confirming cleansing, transformation and load integrity; validated KPI and trend reporting, chaired daily SIT defect triage, and secured written UAT sign-off from business stakeholders.
Data Quality Analyst - Acclaim Systems Inc.
(2017-12 - 2021-01)
Client: Commonwealth of Pennsylvania — Elections & Legislation data estate.
- Validated the electoral data warehouse (voter registration, campaign finance, results) across source-to-staging, staging-to-dimension and dimension-to-fact loads using complex SQL against mapping requirements.
- Executed and monitored Informatica workflows and validated targets using Informatica Data Validation Option with automated scripts.
- Managed requirements, plans, cases and defects in Microsoft TFS; prepared scenario mind-maps with BA and development teams.
Principal Data Validation Engineer - GSS Infotech Ltd.
(2016-10 - 2017-11)
Client: Parexel — Clinical Metrics Data Mart (CMDM). Validated a multi-tenant clinical reporting repository across multiple studies and pharmaceutical clients.
- Used IBM DataStage to load Oracle targets, running and monitoring jobs via DataStage Director and Control-M; ran SIT, regression and end-to-end validation.
QA ETL Tester - Acclaim Systems (India)
(2016-03 - 2016-09)
Client: Geneia — healthcare benefits analytics.
- Delivered end-to-end ETL testing on AWS, validating source-to-target data flow, SCD Type 1/2 logic and transformations; executed SAS jobs and validated across file-to-file, file-to-DB and DB-to-DB levels.
Software Test Engineer - CGI Information Systems (India)
(2014-09 - 2016-03)
Client: PNC Bank — commercial credit risk models (LGD, EAD, PD).
- Tested the re-development of PNC's commercial credit-risk data estate, validating ETL across transformation layers in Informatica and tracking execution and defects in HP Quality Center.
Test Engineer - Infinite Computer Solutions (India)
(2012-04 - 2013-07)
Client: ACS, a Xerox Company — USA.
- Executed end-to-end ETL testing in DataStage and Informatica, data-validation SQL and Control-M job runs, working to onsite coordinators in an Agile team.
Test Engineer - Mphasis, an HP Company
(2009-04 - 2011-06)
Client: Ladbrokes ADW, United Kingdom.
- Delivered functional, regression and end-to-end validation for a UK betting platform; used Informatica to load Oracle and flat-file sources, wrote SQL for target validation and maintained the traceability matrix.
Education
BTech - Computer Science & Engineering - Vivekananda Institute of Technology & Science, JNTU, India (2008)