Ga naar de hoofdinhoud

Data Engineer – Databricks & Python

Technology
Pauwels Consulting
Brussels, België1 maand geleden
VoltijdOp locatie

Functieomschrijving

Our client, a prominent organization in the public sector, is looking for a professional to join their analytics division. The role involves developing AI and analytical building blocks for a modern data platform by exploring and validating new technologies through iterative feasibility studies.

Responsibilities

  • Explore and validate new data and AI technologies through short-cycle feasibility projects.
  • Design and implement scalable ETL processes and data pipelines.
  • Integrate diverse data sources such as databases and APIs into the central analytics platform.
  • Collaborate in multidisciplinary teams to test hypotheses and demonstrate technical potential.
  • Maintain data consistency, quality, and reliability across the entire pipeline lifecycle.
  • Implement Infrastructure as Code (IaC) to support and manage data environments.

Requirements

  • 3+ years of experience as a data engineer.
  • You have experience with Python, Java, or Scala for developing datastreams and ETL processes.
  • You possess hands-on experience with Databricks, Spark, and PySpark for processing large datasets.
  • You bring experience with data lake solutions such as Azure Data Lake or Delta Lake.
  • You have experience using DBT for data transformation and modeling.
  • You possess experience with Terraform or Pulumi for IaC.
  • You have experience connecting data sources via REST APIs and various database systems.
  • You're proactive and solution-oriented in a fail-fast environment.
  • You are fluent in Dutch with a C2 level.

Nice to Haves

  • Familiarity with governmental data standards.

Offer

  • Start date: 15/09/2026
  • Duration: 10 months
  • Work regime: Full-time
  • Location: Brussels
  • Working model: Hybrid
  • Contract: open to both permanent employees and freelancers

Keywords
monthsOfExperience: 36FlutterScalaApache SparkPythonJavaIterationTerraform

Interesse in deze functie?