Vairag Borad

Data Engineer with 6+ years of experience designing and building scalable data platforms across eCommerce, healthcare, legal, and gaming domains. Expertise in Microsoft Fabric, PySpark, Spark SQL, Azure Data Factory, and Python for developing distributed ETL pipelines and Medallion Architecture (Bronze, Silver, Gold). Experienced in processing millions of records using Fabric Notebooks, optimizing Spark transformations, Delta Lake, and building enterprise reporting solutions with Power BI.

Strong background in data modeling, SQL optimization, and end-to-end data engineering within Agile environments.

Data Engineer at MOBILESENTRIX IT INDIA PVT LTD (2023-02 – 2026-06)

• Architected end-to-end data solutions on Microsoft Fabric — designed Lakehouses, built Data Pipelines for multi-source ingestion, and authored PySpark Notebooks for large-scale transformation.
• Implemented Bronze, Silver, and Gold Medallion Architecture using Delta Lake tables with incremental processing and schema evolution.
• Built reusable PySpark transformation frameworks for data cleansing, validation, deduplication, surrogate key generation, and Slowly Changing Dimension (SCD) processing.
• Migrated legacy ADF pipelines to Fabric Data Pipelines and Dataflows Gen2, reducing pipeline maintenance overhead by ~40% and improving refresh reliability.
• Developed production-grade Power BI semantic models with optimised DAX measures, row-level security, and incremental refresh — delivering sub-2-second report load times across 5M+ row datasets.
• Migrated enterprise on-premises Data Warehouse solutions to Microsoft Fabric Data Warehouse, leveraging Fabric Data Factory, Lakehouse, and Power BI Semantic Models to deliver a modern end-to-end analytics platform.
• Designed and optimised T-SQL stored procedures and views in Azure SQL Database and Fabric Warehouse to support downstream Power BI and SSRS reporting.
• Authored Python (Pandas / PySpark) scripts for complex data cleansing, validation, and API-based ingestion workflows integrated into Fabric Notebooks.
• Set up Azure DevOps CI/CD pipelines for automated deployment of Fabric artifacts, ADF pipelines, and SQL objects across Dev / UAT / Prod environments.

MSBI Engineer at MagnusMinds IT Solution (2020-07 – 2023-02)

• Designed and implemented Azure Data Factory (ADF) pipelines for ingesting and orchestrating data from on-premises and cloud sources, enabling a cloud-first data platform.
• Developed PySpark scripts and Python-based ETL processes for data cleansing, transformation, validation, and batch processing of structured and semi-structured datasets as part of modernization initiatives.
• Optimised T-SQL stored procedures, indexes, and execution plans — reduced average query runtime by 35% on a high-volume reporting database.
• Built reusable data transformation logic using Spark DataFrames, Spark SQL, joins, aggregations, and window functions to improve ETL maintainability and performance.
• Developed Power BI dashboards and SSRS paginated reports for operational, financial, and compliance reporting, collaborating closely with business stakeholders to define KPIs and reporting requirements.

B.Tech in Information Technology – UKA Tarsadiya University