Manideep Pabbu

Azure Data Engineer with 2.3 years of professional experience specializing in Azure Databricks, PySpark, SQL, Azure Data Factory, Delta Lake, and Azure Data Lake Storage. Experienced in developing and optimizing ETL/ELT pipelines, data migration workflows, data transformation processes, and data warehouse solutions. Strong hands-on experience with Apache Spark, Delta Lake, Medallion Architecture, data modeling, SQL optimization, and scalable cloud data platforms.

Data Engineer at Quadrant Resources Pvt Ltd. (2024-06 – 2025-09)

• Designed and implemented data solutions and data objects based on business requirements for Actuals and Forecasting (ACR).
• Developed end-to-end ETL pipelines using Azure Data Factory and ADLS Gen2 to ingest and prepare data for analytics.
• Developed Databricks notebooks using SQL and PySpark to process actuals data and generate forecast data for business reporting and analysis.
• Designed and generated fact and dimension tables to support analytical and reporting requirements.

Data Engineer at Hitachi Solutions (2025-10 – Present)

• Working on the migration of enterprise data workloads from on-premises SQL Server/SQL MI to Azure Databricks, modernizing legacy data solutions into a scalable cloud data platform.
• Developed Azure Data Factory (ADF) pipelines to ingest source data from Azure Data Lake Storage (ADLS) into Databricks Bronze tables and implemented bronze, silver, and gold layers using Medallion Architecture.
• Converted legacy SQL Server/SQL MI views and stored procedures into Databricks-compatible views and notebooks, preserving existing business logic and functionality.
• Performed source-to-target data validation, reconciliation, and performance optimization to ensure data accuracy, migration quality, and reliable pipeline execution

Bachelor of Technology (B.Tech) in Computer Science and Engineering – CMR College of Engineering and Technology, Hyderabad (2019 – 2023)