Rahul Ramesh Parwekar
Data Engineer with databricks and pysparks
Hire this person
Send a job offer directly to this candidate
About
Senior Data Engineering Lead with 15+ years of experience designing and modernizing enterprise data platforms across financial services and analytics domains. 5+ years of hands-on experience in Azure Data Engineering stack including Databricks, PySpark, SQL, and Synapse Analytics, with 2+ years of Azure Data Lake (ADLS Gen2) and Azure Data Factory (ADF). Proven expertise in building scalable batch and transformation pipelines using Delta Lake architecture (Bronze–Silver–Gold), optimizing Spark workloads, and leading cross-functional data engineering teams (5 members). Strong background in SQL performance tuning, cloud migration initiatives, and enterprise BI transformation programs.
Experience
Senior Data Engineer Lead at Luxoft (2023-04 – Present)
Led data engineering initiatives designing and implementing scalable data pipelines using Databricks and Azure Data Lake with Bronze-Silver-Gold architecture. Built incremental ingestion pipelines, orchestrated ETL workflows, and optimized Spark workloads for high-volume financial datasets.
- Designed and implemented scalable data pipelines using Databricks (PySpark) and Azure Data Lake following Bronze–Silver–Gold architecture
- Built incremental ingestion pipelines using Delta Lake MERGE operations and optimized Spark transformations for high-volume financial datasets
- Developed and orchestrated ETL workflows using Azure Data Factory integrating SQL Server, Oracle, and ADLS
- Engineered data models in Azure Synapse Analytics supporting enterprise reporting and analytical workloads
- Optimized Spark jobs using partitioning strategies, broadcast joins, caching, and file size tuning
- Led a team of 5 data engineers, overseeing code quality, architecture decisions, and delivery timelines
- Migrated legacy SQL-based ETL workflows into cloud-based distributed processing pipelines
- Improved data processing efficiency by 35–40% through Spark and SQL optimization techniques
- Collaborated with business stakeholders to design scalable data solutions aligned with cloud modernization initiatives
Data Engineering Lead / BI Modernization at Synechron (2022-09 – 2023-01)
Supported UBS data modernization initiatives using Azure Synapse and Power BI. Developed PySpark and SQL transformations for financial data reconciliation and reporting, integrating SAP ECC and SQL Server datasets into Azure Data Lake.
- Supported UBS data modernization initiatives using Azure Synapse and Power BI
- Developed PySpark and SQL transformations for financial data reconciliation and reporting
- Integrated SAP ECC and SQL Server datasets into Azure Data Lake for downstream analytics
- Enhanced ETL pipeline performance and ensured data accuracy across reporting layers
Senior Database Lead / BI Specialist at Atos-Syntel (2016-05 – 2022-09)
Led SQL and ETL engineering for BARCLAYS global analytics platforms. Designed enterprise data warehouse solutions, developed Power BI dashboards for executive reporting, and implemented performance tuning strategies achieving significant improvements in query execution time.
- Led SQL and ETL engineering for BARCLAYS global analytics platforms
- Designed enterprise data warehouse solutions and automated ETL processes
- Developed Power BI dashboards for executive reporting used by 200+ business users
- Implemented performance tuning strategies achieving up to 80% improvement in query execution time
- Contributed to early-stage cloud evaluation and migration roadmap discussions
Database Developer at IBM (2011-03 – 2016-05)
Developed high-performance SQL procedures and reporting solutions. Designed complex data transformation and cleansing scripts, and supported integration of multiple enterprise data sources into centralized analytical systems.
- Developed high-performance SQL procedures and reporting solutions
- Designed complex data transformation and cleansing scripts
- Supported integration of multiple enterprise data sources into centralized analytical systems
Database Developer at Rave Technologies (2006-10 – 2011-03)
Designed transactional and analytical database systems. Implemented indexing strategies and optimized reporting queries, and integrated SAP and SQL-based data pipelines for enterprise reporting.
- Designed transactional and analytical database systems
- Implemented indexing strategies and optimized reporting queries
- Integrated SAP and SQL-based data pipelines for enterprise reporting
Education
Master of Computer Applications in Computer Applications – Jabalpur Engineering College
Bachelor of Science in Mathematics & Computer Science – Khalsa College
