Skip to main content
Nilesh Rane

Nilesh Rane

Lead Data Engineer

Talent
BengaluruMember since April 22, 2026
ETL pipeline developmentPII Data Governance toolsData integration and modelingAWS Services (EC2, S3, Glue, Airflow, Appflow)DockerKubernetesGithubCICDSQLPL-SQLRedshiftBigQueryDatabricksDelta lakeData LakePythonPySparkKafkaData MigrationData Quality ManagementLeading Team and Building Team
·

Hire this person

Send a job offer directly to this candidate

ETL pipeline developmentPII Data Governance toolsData integration and modelingAWS Services (EC2, S3, Glue, Airflow, Appflow)Docker

About

Strategic Data Engineering Lead with deep expertise in architecting scalable ETL/ELT pipelines and executing cloud migrations. Proficient in Delta lake, AWS, PySpark, Oracle PL/SQL, and Databricks. Achievements in data governance and PII remediation across 1,000+ tables. Leads cross-functional teams to enhance data quality and deliver compliance-aligned, business-critical solutions.

Experience

Data Engineering Lead at AngelOne (2023-12 – Present)

Led and mentored data engineering team, architecting scalable ETL/ELT pipelines and enterprise-wide initiatives

  • Led and mentored data engineering team, architecting scalable ETL/ELT pipelines using Databricks delta lake, AWS Glue, Redshift, Airflow, Appflow, S3, PySpark, and Python, establishing best practices and automating production workflows across cross-functional teams
  • Engineered real-time data integrations with Third party as well as internal systems and implemented Medallion Architecture (Bronze/Silver/Gold), enhancing data quality, lineage, and accessibility for business intelligence using Databricks Unity catalog, delta tables and streaming pipelines
  • Led enterprise cross-cloud migrations (GCP BigQuery → AWS Redshift/S3 & Databricks) while managing hybrid storage environments (Redshift, DynamoDB, BigQuery), optimizing performance, cost-efficiency, and low-latency analytical scale
  • Built advanced customer segmentation, cohorts, and retargeting buckets powering Meta & Google ad campaigns, directly boosting active user rates and unlocking revenue from dormant leads
  • Architected enterprise-wide PII Remediation Framework to remediate sensitive data across 1,000+ tables and master datasets, designing centralized Data Vault with strict access controls (AWS Lakeformation), encryption, and zero-trust retrieval for critical use cases
  • Established DMZ Account and NAT Gateway architecture for secure vendor data sharing

Team Lead at Saama Technologies (2022-04 – 2023-12)

Engineered multi-client data integrations and implemented clinical study domain mappings

  • Engineered multi-client data integrations using Python, Kafka, PySpark, Airflow, Git, and Docker, enabling reliable real-time data streaming and workflow orchestration between clinical applications
  • Implemented CDISC-compliant Clinical Study domain mappings across therapeutic areas including Adverse Events, Concomitant Medications, Medical History, Laboratory (Local & Central), Demographics, Dispositions, and Protocol Deviations
  • Processed and transformed clinical data across multiple file formats — XPT, SAS7BDAT, AVRO, PARQUET, and CSV — ensuring compatibility and integrity across downstream systems
  • Integrated data from EDC source systems (RAVE, VEEVA, CTMS) using CRF documentation to accurately map and validate clinical trial data for analysis and reporting
  • Developed Clinical and Operational analytics dashboards using SQL, Python Pandas, Amazon S3, and ETL tools, delivering study-level insights on Site & Country milestones for Clinical Research Organizations (CROs)
  • Diagnosed and resolved complex dashboard and backend reporting issues by analyzing data anomalies and optimizing multi-layered SQL logic, ensuring accuracy and reliability of clinical reporting

Associate at Deutsche Bank (2021-08 – 2022-04)

Led incident, problem, and change management with IT audit and regulatory compliance

  • Led incident, problem, and change management; ensured IT audit and regulatory compliance through Geneos monitoring and cross-channel XServices support

IT Business System Analyst at Axis Bank (2019-05 – 2021-08)

Architected data migration pipelines and internet banking data migrations

  • Architected data migration pipelines using Oracle GoldenGate, PL/SQL, and HikariCP, migrating 2–5 lakh customers in 1–2 hours with parallel execution and zero disruption, enhancing Payment Gateway security, developing high-throughput beneficiary API (50+ lakh daily requests), delivering SQL dashboards, implementing ML-inspired campaigning procedures, and managing end-to-end migration lifecycle including data mapping, DB setup, and performance tuning
  • Led end-to-end Retail & Corporate internet banking data migration for Axis & RBL Bank (with Infosys), managing FEBA build/deployment, migrating critical modules (SI, Payee, MOBANK, Credit Card) from legacy systems to Finacle eBanking 11, developing PL/SQL procedures, tuning performance via AWR/ASH reports, ensuring data quality, audit compliance, and coordinating cross-functional teams for seamless delivery

Software Engineer at Nelito Systems (2015-10 – 2019-05)

Managed retail and corporate internet banking data migration projects

Education

PG Diploma in Computer And Information Systems – CDAC (2015-08 – 2015-08)

Bachelor Of Engineering in Computer Engineering – Pune University (2014-08 – 2014-08)

Skills

Lead Data Engineer

Reviews

Related