Pranav Arakhrao

Data Engineer with 3 years of experience in designing, developing, and maintaining scalable data solutions using Microsoft Azure Databricks, Azure Data Factory (ADF), ADLS Gen2, Delta Lake, and Apache Spark. Skilled in building end-to-end ETL pipelines for data generation, collection, processing, and migration across systems while ensuring data quality, governance, and reliability. Experienced in batch processing, incremental and idempotent data loads, Spark performance optimization, and implementing robust ETL logging frameworks for high-volume data processing.

Strong understanding of data modelling concepts and best practices. Proven ability to optimize pipelines for performance and cost efficiency while collaborating with cross-functional teams to deliver reliable and scalable data solutions.

Azure Data Engineer at Zensar Technologies (2024 – Present)

• Designed and implemented robust end-to-end ETL pipelines using Azure Databricks, Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), and Delta Lake to ingest and transform machine log data.
• Integrated data from multiple enterprise sources including SharePoint, GitLab, SAP S/4HANA, and REST APIs, ensuring data consistency, schema enforcement, and reliable batch processing.
• Optimized the ETL pipelines using parallel processing, partitioning strategies, and batch logic, reducing end-to-end runtime from 15 hours to 3 hours.
• Eliminated inefficient row-by-row operations and improved resource utilization, resulting in approximately 50% monthly cloud cost savings.
• Worked with Azure Databricks Unity Catalog to understand centralized governance, fine-grained access control, and metadata management, supporting secure data access and lineage tracking across environments.
• Developed refined data models and curated Delta tables to support interactive Power BI dashboards, enabling faster insights and enhanced decision-making.
• Conducted proofs of concept (POCs) for near real-time data processing using Azure Event Hubs and Azure Stream Analytics, demonstrating streaming ETL capabilities.
• Built a comprehensive ETL logging and audit framework capturing pipeline execution details, file-level metadata, run status, timestamps, and error information for enhanced monitoring and traceability.

Project management Intern at Source code Technology (2022-12 – 2023-06)

• Collaborated with cross-functional teams, including Development, QA, and Business teams to ensure seamless delivery of projects across various phases of the development lifecycle.
• Analyzed project metrics and data to identify areas for improvement in the development lifecycle process, leading to a 10% increase in overall project success rate.
• Drafted and maintained detailed project plans for multiple analytics initiatives, resulting in on-time and successful completion of projects assigned.

B.E in Computer Engineering – JSPM's Rajarshi Shahu College of Engineering, Savitribai Phule Pune University (2018 – 2022)