Data Engineer

Description

Expertise on Azure platforms including Azure Databricks, ADLS, and its various components, • In-dept knowledge and hands-on experience in Microsoft Azure data stack i.e., Azure Data Factory, Azure SQL Database, Azure Functions, Logic apps, Spark and Python programming etc.

• Expertise on Azure platforms including Azure Databricks and its various components, including Delta Lake.
• Strong understanding of data architecture and data management principles.
• In-dept knowledge and hands-on experience in Microsoft Azure data stack i.e., Azure Data Factory, Azure Synapse, Azure SQL Database, Azure Functions, Logic apps, Spark Knowledge etc.
• In-depth Knowledge on designing of ETL Piplines for Batch and Real time in Azure data factory and Azure datafactory • Hands on experience on Function apps , Event Hubs,, Web apps , API M.
• Good have to experience on Migration to Salesforce • Strong experience with designing ETL/ELT Pipelines/Data flows using Azure Data Factory as Primary skill and SSIS/Informatica as additional skills.
• Proficiency in programming languages such as Python, SQL, Spark notebooks and Scala.
• Must have strong development & design skills in leading RDBMS environments e.g. MS SQL Server and Oracle 10g.
• Experience of Big data approach, architectural concepts, data sourcing/ ingestion/ curation and storage mechanisms.
• Experience with real-time / near-real-time Data warehousing concepts and Design approaches.