AZURE FABRIC DATA ENGINEEFR
Send a job offer directly to this candidate
5+ years of experience in Data Engineering with expertise in - Azure Fabric, Azure Data Lake Store (ADLS), Azure SQL, Azure Data Factory (ADF), Azure Databricks (ADB), Azure DevOps, Azure Synapse Analytics, Azure BLOB storage, Azure Logic App, Key Vault, SQL Server, PySpark, Spark SQL, etc.
ADF building components - Integration Runtime, Linked Services, Data Sets, Pipelines, Activities.
Data ingestion pipelines from on-premise to different layers into the ADLS using Azure Data Factory (ADF V2).
Medallion Architecture (Bronze, Silver, Gold layers).
Azure Logic App integration tool.
Environment details in Azure Key Vault.
Azure Databricks (ADB) Spark-Python Notebooks. Data Frames and Spark SQL.
Data integration pipeline orchestration in ADF using various Activities like Get Metadata, Lookup, For Each, Wait, Execute Pipeline, Set Variable.
Data migration from on-premises SQL Server to Microsoft Fabric.
Generative AI (GenAI) models to analyze large datasets
Azure OpenAI Service for embedding GenAI capabilities into workflows
MS in Data Analytics and Information Systems