Azure Data Engineer / Analyst
اطلب عرض سعر بدون التزام
Dedicated Data Engineer experienced in designing and developing robust data pipelines, optimizing ETL processes, and enabling data-driven decision-making. Seeking a challenging role to leverage my skills and expertise in a dynamic organization.
Working on Azure services for development and implementation of the ELT and ETL pipeline. Data from 4 regions (NAA, EMEA, APAC and China) were integrated with the help of Azure Data Factory and MS-SSIS from on-premises databases to Azure cloud. Implemented ELT pipelines via Azure Databricks for servicedata in Python PySpark, streaming real-time data via AutoLoader and storing data into DataLake. Databricks features - DeltaLake, unity catalog, autoloader and Databricks SQL.
Cloud service like- ADF, Azure Blob Storage, Azure Event Hubs, Azure Synapse Analytics and for Database, experienced in MySQL, MS SQL Server, snowflake. Defined workflows to process real-time events via ServiceBus and EventHub with Azure Function app and Azure SQL DB, optimizing a previously slow batch process. Built ETL pipelines with ADF for data modeling, parallel processing, and automation. Enhanced existing modules, automated manual processes and developed new features.
bachelor of technology
