Senior Data Engineer

Job Title: Senior Data Engineer – Azure Databricks

Experience: 6–8 Years

Location: Dubai, UAE

Employment Type: Full-Time

Job Description

We are looking for an experienced Senior Data Engineer with strong hands-on expertise in Azure Data Factory (ADF), Azure Databricks, Azure Data Lake, SQL, Python, and PySpark. The ideal candidate should have experience designing and building scalable data pipelines and platforms, preferably within the Banking, Financial Services, or Wealth Management domain.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory and Azure Databricks.
• Build and optimize data solutions using ADLS Gen2, Delta Lake, SQL, Python, and PySpark.
• Develop reliable and high-performance data pipelines for structured and unstructured data.
• Implement data quality, governance, security, and operational best practices.
• Work with business, analytics, BI, and technology teams to deliver trusted datasets and data products.
• Monitor, troubleshoot, and optimize data pipeline performance, scalability, and reliability.
• Work on Data Modeling, Data Warehousing, Delta Lake, and Medallion Architecture.
• Support integration and transformation of data from core banking, wealth management, and enterprise applications.
• Maintain technical documentation, source code repositories, and CI/CD deployment processes.
• Participate in Agile delivery and collaborate with cross-functional stakeholders.

Mandatory Skills

• 6–8 years of experience in Data Engineering
• Strong hands-on experience with Azure
• Azure Data Factory (ADF) – Mandatory
• Azure Databricks – Mandatory
• ADLS Gen2 / Azure Data Lake
• SQL
• Python
• PySpark
• Delta Lake
• ETL/ELT pipeline development
• Data Modeling and Data Warehousing
• Medallion Architecture
• Data Quality and Data Governance

Preferred Skills

• Experience in Banking, Financial Services, or Wealth Management
• Knowledge of banking data domains such as:
• Customer
• Account
• Portfolio
• Holdings
• Transactions
• KYC
• AML
• Regulatory Reporting
• Experience integrating data from core banking or wealth management platforms
• Experience with CI/CD and source code repositories
• Azure and/or Databricks certifications

Education

• B.Tech / B.E. in Computer Science, Engineering, Information Technology, or a related field.

Key Competencies

• Strong analytical and problem-solving skills
• Good stakeholder management and communication skills
• Ability to translate business requirements into scalable technical solutions
• Experience working in Agile and cross-functional teams

Location: Dubai, UAE

Experience: 6–8 Years

Skills: Azure, Azure Data Factory, Azure Databricks, ADLS Gen2, PySpark, Python, SQL, Delta Lake, Data Engineering, ETL/ELT, Banking Domain