Skip to main content
Venkatnarasimha M

Venkatnarasimha M

Lead Data Engineer · Data Quality, ETL & Warehousing

Talent
Glasgow, ScotlandMember since July 30, 2026
PythonPySparkSQLUnix shell scriptingMicrosoft AzureAWSDatabricksRule-based DQ frameworksSource-to-target validationMetadata and lineage verificationStar schemaJenkinsGitInformaticaIBM DataStageMSBIControl-MHP ALMJIRAConfluenceAgileHadoopHiveImpalaTeradataOracleMS SQL ServerPostgreSQLTableauCognos
·

Hire this person

Send a job offer directly to this candidate

PythonPySparkSQLUnix shell scriptingMicrosoft Azure

About

Lead data engineer with 16 years across banking, healthcare and public sector, combining hands-on data engineering and warehousing with deep expertise in data quality, validation and observability. Designs and implements scalable data pipelines and rule-based quality frameworks in Python, PySpark and SQL, models and validates warehouse structures (star schema, dimension/fact, incremental loads), and sets engineering standards across teams. Leads implementation of data-quality and monitoring frameworks — moving beyond basic checks to volumetric, trend and anomaly validation — and drives root-cause analysis and resolution of data incidents.

Works with CI/CD and version-controlled workflows (Jenkins, Git), Unix/Bash shell scripting, and cloud data platforms (Azure and AWS). Acts as a technical point of escalation, mentoring engineers and setting standards for testing, validation and code quality. Currently at PNC Bank, following four and a half years on the bank's AML Analytics Hub leading onshore/offshore teams of up to ten.

Experience

Data Engineer - Incedo Inc.

(2026-02)

Client: PNC Bank — Credit Line Management (CLM) platform. Lead quality engineering for big data applications spanning data ingestion (ARL), workflow orchestration (RLO) and downstream decisioning, across consumer and business card portfolios.

  • Build and run rule-based validation and reconciliation checks in PySpark on Databricks to assure large-scale ingestion, transformation and load; embed automated data-quality checks into Jenkins CI/CD pipelines with Git on Azure, verifying integrity on each build and deployment.
  • Own test/QE strategy and effort estimation from functional requirements and mapping documents; direct onshore and offshore engineers to agreed standards.
  • Verify data quality, lineage and integrity end to end, reconciling upstream sources against downstream output; maintain requirement-to-defect traceability in JIRA and secure formal SIT, UAT and regression sign-off.

Data Engineer, ETL & Reporting - Palnar Inc.

(2025-08 - 2026-02)

Client: Fidelity Health Benefits — employee health & wellness benefits platform.

  • Skilled in ETL design, data validation and building pipelines in Python, SQL and PySpark; built automated data-quality checks as rule-based PySpark frameworks in Databricks, integrated into Jenkins CI/CD pipelines with Git for continuous regression coverage.
  • Validated ETL across medical, dental, vision and supplemental benefits data from enrolment through claims, writing complex aggregation SQL against Oracle; assured Tableau and Kibana reporting and reconciled high-volume data across heterogeneous systems.
  • Produced strategy, plan and summary documentation for SIT and UAT, managing traceability in JIRA.

Senior Data Quality Consultant - CGI Information Systems

(2021-01 - 2025-08)

Client: PNC Bank — AML Analytics Hub (AAH), Big Data Platform. Quality engineering lead on the modernisation of PNC's anti-money-laundering estate onto its Big Data Platform, supporting advanced tuning methodology and machine-learning model management. Delivered the BBVA USA migration following PNC's acquisition of BBVA — a large-scale data-consolidation programme across heterogeneous source systems.

  • Developed Python and PySpark automation for data quality frameworks in Databricks, scaling assurance across modules and pipelines; worked with data lakes managing structured and unstructured banking data, and embedded data-quality tests into Jenkins CI/CD pipelines on Azure to automate regression across releases.
  • Led a distributed engineering team of ten across onshore and offshore, owning delivery to SLAs and audit protocols; owned QE strategy and traceability in HP ALM with source-to-target validation through every load stage.
  • Reconciled large data volumes between heterogeneous systems, confirming cleansing, transformation and load integrity; validated KPI and trend reporting, chaired daily SIT defect triage, and secured written UAT sign-off from business stakeholders.

Data Quality Analyst - Acclaim Systems Inc.

(2017-12 - 2021-01)

Client: Commonwealth of Pennsylvania — Elections & Legislation data estate.

  • Validated the electoral data warehouse (voter registration, campaign finance, results) across source-to-staging, staging-to-dimension and dimension-to-fact loads using complex SQL against mapping requirements.
  • Executed and monitored Informatica workflows and validated targets using Informatica Data Validation Option with automated scripts.
  • Managed requirements, plans, cases and defects in Microsoft TFS; prepared scenario mind-maps with BA and development teams.

Principal Data Validation Engineer - GSS Infotech Ltd.

(2016-10 - 2017-11)

Client: Parexel — Clinical Metrics Data Mart (CMDM). Validated a multi-tenant clinical reporting repository across multiple studies and pharmaceutical clients.

  • Used IBM DataStage to load Oracle targets, running and monitoring jobs via DataStage Director and Control-M; ran SIT, regression and end-to-end validation.

QA ETL Tester - Acclaim Systems (India)

(2016-03 - 2016-09)

Client: Geneia — healthcare benefits analytics.

  • Delivered end-to-end ETL testing on AWS, validating source-to-target data flow, SCD Type 1/2 logic and transformations; executed SAS jobs and validated across file-to-file, file-to-DB and DB-to-DB levels.

Software Test Engineer - CGI Information Systems (India)

(2014-09 - 2016-03)

Client: PNC Bank — commercial credit risk models (LGD, EAD, PD).

  • Tested the re-development of PNC's commercial credit-risk data estate, validating ETL across transformation layers in Informatica and tracking execution and defects in HP Quality Center.

Test Engineer - Infinite Computer Solutions (India)

(2012-04 - 2013-07)

Client: ACS, a Xerox Company — USA.

  • Executed end-to-end ETL testing in DataStage and Informatica, data-validation SQL and Control-M job runs, working to onsite coordinators in an Agile team.

Test Engineer - Mphasis, an HP Company

(2009-04 - 2011-06)

Client: Ladbrokes ADW, United Kingdom.

  • Delivered functional, regression and end-to-end validation for a UK betting platform; used Informatica to load Oracle and flat-file sources, wrote SQL for target validation and maintained the traceability matrix.

Education

BTech - Computer Science & Engineering - Vivekananda Institute of Technology & Science, JNTU, India (2008)

Skills

Lead Data EngineerData QualityETL & Warehousing

Reviews

Related