Harish Cheruku

Data Engineer with 4 years of experience designing and supporting enterprise-scale data pipelines on Microsoft Azure for global banking clients. Built and optimized ETL/ELT workflows processing 1+ TB/day, achieving up to 35% performance improvement and processing large-scale datasets efficiently while meeting performance and reliability SLAs.

Developed

PySpark and Spark SQL transformations to cleanse, aggregate, and enrich structured and semi-structured datasets for analytics and reporting. Strong expertise in Azure Data Factory, Databricks (PySpark), ADLS Gen2, and Snowflake with proven L3 production support ownership. Designed and maintained analytical data models and schemas, optimizing query performance and storage efficiency.

Ensured data quality and integrity through validation checks, reconciliation logic, and automated monitoring frameworks. Monitored and troubleshot ADF pipelines and Databricks workflows, providing L3 / UAT production support and resolving performance bottlenecks. Integrated multiple data sources (cloud & on-prem) into centralized data lake and warehouse solutions using SQL, PySpark, and ADF.

Implemented CI/CD pipelines using Git, GitHub/GitLab, Jenkins, and Azure DevOps to automate deployment of data pipelines. Applied data security and governance best practices, including RBAC and secure data handling in Azure environments. Continuously optimized Spark jobs, SQL queries, and orchestration logic to improve overall system efficiency and stability.

Data Engineer at BNP Paribas (2023-03 – Present)

Data Engineer at BNP Paribas handling enterprise-scale data pipeline design and support

Associate Analyst (Data Engineering) at BNP Paribas (2022-07 – 2023-03)

Associate Analyst in Data Engineering division

Analyst Intern (Data Engineering) at BNP Paribas (2022-02 – 2022-07)

Analyst Intern in Data Engineering division

Bachelor's Degree in Computer Science and Engineering – JNTUH