Vipul Patil

Data Engineer with 4+ years of experience building scalable ETL pipelines and modern dataplatforms using Azure cloud services, Apache Spark, and Python. Strong expertise in SQL, PySpark, and Spark SQL for large-scale distributed data processingand transformation. Hands-on experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics,and ADLS Gen2 for building enterprise data platforms.

Experience designing Medallion Architecture (Bronze, Silver, Gold) data lakes andimplementing dimensional data models for analytics and BI workloads. Skilled in data ingestion, validation, pipeline monitoring, and performance optimization for largedatasets.

Data Engineer at Successive Digital (2021-01 – Present)

Data Engineer responsible for designing and developing ETL pipelines and data platforms using Azure cloud services.

• Designed and developed end to end batch ETL pipelines using Azure Data Factory and Azure Databricks to automate enterprise data ingestion.
• Built PySpark pipelines processing large datasets from APIs and relational databases intoADLS Gen2.
• Optimized Spark and PySpark jobs improving pipeline performance and reducing executiontime.
• Implemented data validation checks and schema validation to ensure high data quality andconsistency.
• Designed Medallion Architecture (Bronze, Silver, Gold) data lake layers for scalable datatransformation and analytics.
• Developed dimensional data models and loaded curated datasets into Azure Synapse Analyticsfor BI reporting.
• Monitored ADF pipelines, troubleshot workflow failures, and implemented logging anderror handling mechanisms.

Bachelor of Engineering (BE) in Computer Science – D. N. Patel College Of Engineering

Diploma in Engineering in Computer Science – Government Polytechnic