(Senior) Azure Data Engineer

Context

AETHER is a key partner for intrapreneurial projects in Belgium, and we want to reinforce our support of key actors in the public transportation sector, who are facing interesting challenges regarding the secure and efficient use of data to support business decisions.

New projects are therefore ongoing to ensure that business teams can access reliable data for reporting and analysis while keeping access rights and platform costs under control.

Hence why we are looking for a senior Azure Data Engineer to strengthen our team of Project Partners.

Task Description

As an AETHER Project Partner embedded within the project team, your objective will be to design, develop, and maintain reliable, scalable data solutions on Microsoft Azure while improving platform architecture, data governance, self-service access, performance, security, and costs.

Key Responsibilities Might Include

• Design and develop data pipelines using Azure Data Factory, Databricks, and other Azure services.
• Implement modern data architectures using Data Lake, Delta Lake, and Lakehouse approaches.
• Develop and industrialize new business use cases so they can run reliably in production.
• Contribute to implementing and managing Databricks Unity Catalog, including catalogs, schemas, permissions, data sharing, and governance.
• Support the implementation of a self-service data strategy for business teams.
• Monitor and optimize Azure and Databricks performance, resource use, and costs.
• Automate data ingestion, transformation, and deployment processes.
• Collaborate with Data Analysts, Data Scientists, and business stakeholders.
• Document data flows, architecture, and best practices.
• Contribute to maintaining and continuously improving the Azure Data Platform.

Profile

• Degree in Computer Science, Data Engineering, or a related field.
• At least 5 years of experience in a similar role.
• Proven experience with Azure Databricks, Unity Catalog, and Azure data architecture.
• Expert-level skills in SQL, Databricks, Spark, Python, Azure Data Factory, Azure Data Architecture, and Databricks Unity Catalog.
• Advanced skills in Power BI.
• Strong experience with Azure Data Factory, Azure Databricks, Azure Storage, Azure SQL, Key Vault, and Azure DevOps.
• Hands-on experience with Databricks Unity Catalog, including access management, security, and data governance.
• Strong knowledge of Azure Databricks architecture, including Lakehouse design, scalability, security, and best practices.
• Experience with Spark, PySpark, and Delta Lake.
• Experience with monitoring, performance tuning, and cost optimization in Azure and Databricks.
• Knowledge of CI/CD principles applied to data engineering.
• Knowledge of application integration patterns, including REST API and AMQP.
• Analytical mindset, autonomy, problem-solving skills, and team spirit.
• Strong communication skills and the ability to explain technical concepts clearly.
• Bilingual French and Dutch, and professional working proficiency in English.
• Availability for an 11-month assignment in Belgium, from 4 January to 31 December 2027.
• Microsoft Azure or Databricks certifications are a plus.
• Experience with Power BI administration and governance is a plus.
• Experience with real-time data streaming is a plus.
• Experience with Terraform or Infrastructure as Code is a plus.
• Familiarity with Azure Monitor and Log Analytics is a plus.
• Basic SAP knowledge, including S/4HANA or BW/4HANA as data sources, is a plus.
• Experience working in Agile/Scrum environments is a plus.
• An entrepreneurial experience or ambition is a plus, including extra-professional or extra-academic activities.
• Fast availability is preferred.
• Valid single permit required for non-EU citizens.

Our Vision

Success in industry often relies on key individuals who demonstrate intrapreneurial leadership — those who continuously initiate, transform, and pursue excellence.

The best way to develop this strength is through ad interim projects, i.e. working as a consultant with established intrapreneurs in international companies, to support their major expansion or improvement initiatives regarding governance, studies, or operations.

Since 2014, AETHER is managing these opportunities for outstanding consultants in key international groups, as these offer greater learning opportunities with multi-million impacts.

Please share your cv and we will check if this demand is the current best opportunity for your career as a consultant.

INSPIRE | LEAD GROWTH | CREATE IMPACT