Azure Data Engineer - Innovic solutions ltd - UK
(2025-08 - 2026-03)
- Developed and published Power BI dashboards and interactive reports, enabling real-time, data-driven business decisions across multiple business units.
- Built and maintained high-complexity SQL queries and stored procedures in Azure SQL and MySQL for large-scale data extraction, transformation, and analysis.
- Automated data validation processes using Python and Azure, improving data accuracy by eliminating manual quality checks.
- Implemented Python ETL scripts integrated with Azure Databricks and Azure Data Factory (ADF) to ingest data from CRM platforms, cloud storage, and relational databases.
- Developed high-performance Power BI data models with complex DAX calculations, improving dashboard responsiveness and report performance.
- Integrated third-party and CRM data sources with Azure SQL and Power BI, enhancing customer data accuracy and reporting reliability.
- Designed and implemented database schemas, indexing strategies, and Azure Data Lake Storage (ADLS) solutions for scalable, fast-access architecture.
- Implemented metadata management and role-based access control (RBAC) using Unity Catalog to ensure compliant and secure data access.
- Enhanced ETL pipeline monitoring and alerting to maintain continuous, uninterrupted data processing and reporting.
Data Engineer - Hapag-Lloyd
(2022-07 - 2024-06)
- Designed and built complex ETL pipelines using Azure Synapse Analytics and Azure Data Factory (ADF) with mapping data flows, schema modifier transformations, and row modifier transformations.
- Orchestrated end-to-end data pipelines using ADF Medallion Architecture to ingest raw data from multiple sources into the bronze layer of Azure Data Lake Storage Gen2 (ADLS Gen2).
- Worked across Azure IaaS and PaaS services including Key Vault, Logic Apps, and Azure Functions for pipeline automation, networking, and security.
- Established CI/CD pipelines within Azure workspaces, improving deployment automation and release consistency.
- Implemented version control using Git, ensuring meticulous code management and fostering collaboration across development teams.
- Applied data lineage, data catalogues, and validation checks in SQL, ADF, and Synapse to ensure data quality for downstream reporting and analytics.
- Connected Power BI reports to Delta Lake for real-time streaming, improving data accessibility and report performance.
- Developed and published Power BI dashboards available via Power Platform Service and Mobile App, supporting business stakeholders at all levels.
BI & Analytics Engineer - Westpac Banking Corporation, Flipkart
(2021-03 - 2022-06)
- Designed and implemented data pipelines using Azure Synapse Analytics, Azure Data Factory (ADF), and Spark SQL to automate data ingestion and processing.
- Conducted data modeling and transformation on raw data from Azure Delta Lake into structured datasets using SSIS, ADF, and SQL.
- Built and maintained data models including data tables, relationships, and data dictionaries, enabling business trend analysis.
- Developed advanced Power BI reports with DAX-based calculated columns, measures, and row-level security (RLS) for non-technical stakeholders.
- Migrated existing Tableau reports and dashboards to Power BI, ensuring seamless transition and improved functionality.
- Optimised DAX formula performance using DAX Studio, applying best practices to reduce query execution times.
- Collaborated with cross-functional teams to gather requirements and design BI and ETL solutions tailored to specific business needs.
Data Analyst - AXA XL, Blue Dart
(2020-04 - 2021-02)
- Gathered and documented DWH, Data Engineering, and Business Intelligence requirements from stakeholders, ensuring alignment with strategic objectives.
- Built dynamic Azure Data Factory (ADF) pipelines using Watermark Tables, parameters, and variables to process multiple data tables and files within a single pipeline.
- Designed SSIS packages with robust error handling and event handling mechanisms for efficient ETL processes.
- Designed Tableau reports using table calculations, Level of Detail (LOD) functions, filter parameters, and actions.
- Created complex, self-service Power BI and SSRS reports with advanced chart types for business analysis.
- Wrote custom T-SQL statements including triggers, stored procedures, views, indexes, and user-defined functions.
- Developed reusable SSIS templates dynamically deployable across Dev, Test, and Production environments.
Business Intelligence Developer - HDFC Bank, MetroHealth
(2019-02 - 2020-03)
- Designed and developed end-to-end SSIS ETL packages for data extraction and transformation across multiple source systems.
- Created SSRS metadata reports including execution time and failure reports to support operational monitoring.
- Improved SSRS and Excel report performance by tuning stored procedures and T-SQL queries.
- Designed Data Marts and multi-dimensional models using Star and Snowflake schemas, implementing Slowly Changing Dimensions (SCD Type 2 and Type 3).
- Conducted backend database development in SQL using complex queries and stored procedures.
- Published dashboards and reports on Tableau Server for interactive data visualisation.
- Developed Dimensional Data Models to identify Facts and Dimensions and build fact and dimension tables.