Zum Hauptinhalt springen

Python Data Engineer

Technologie
XpertDirect
Berlin, DeutschlandVor 5 Tagen
Vollzeit

Stellenbeschreibung

Python Data Engineer

Berlin, Germany — Hybrid

Our client, a growing Climate Technology company based in Berlin, is looking for a Python Data Engineer to develop, automate, and maintain scalable data pipelines supporting environmental analytics, operational reporting, and data-driven software products.

You'll work at the intersection of Data Engineering, Cloud Infrastructure, and Climate Technology, building reliable data systems that transform complex datasets into accessible, high-quality information for engineering, analytics, and product teams.

Core Skills

  • 3+ years in Data Engineering, Python Development, Data Platform Engineering, or a similar role
  • Strong Python development experience
  • SQL
  • Apache Airflow or comparable workflow orchestration tools
  • PostgreSQL / relational databases
  • AWS
  • Apache Spark or comparable large-scale data-processing tools
  • Docker / containerisation
  • Experience developing and maintaining production data pipelines
  • Understanding of data modelling, transformation, and data quality

Nice to Have

Pandas / NumPy

PySpark

AWS S3 / Glue / Lambda dbt

Snowflake / Databricks

Kafka

REST API integrations

Data warehousing

Data lake / lakehouse architectures

Terraform

GitHub Actions / GitLab CI

CI/CD for data pipelines

Data observability and monitoring

Time-series data processing

Experience with environmental, energy, or climate-related datasets

Keywords
GitLabOrchestrationApache KafkaApache SparkCloud computingApache AirflowNumPyAirflowPostgresqlPythonSqlApache Http ServerCI/CDBig data

Interessiert an dieser Stelle?