Data Engineer
Technologie
Bonn, DeutschlandVor 1 Monat
Dienstleistungsvertrag
Stellenbeschreibung
Job Summary
We are looking for an experienced Senior Data Engineer with a minimum of 6 years of professional experience to join our team in Bonn, Germany.
The ideal candidate will have strong hands-on experience in designing, developing and maintaining scalable data pipelines, data platforms and data solutions, along with excellent communication skills in German and English.
Key Responsibilities
- Design, develop and maintain scalable ETL/ELT data pipelines.
- Build and optimize batch and streaming data-processing solutions.
- Work extensively with Python, SQL and Spark/PySpark.
- Develop and maintain data models using modern approaches such as Data Warehouse, Data Vault and Lakehouse.
- Work with data orchestration tools such as Apache Airflow.
- Work with modern data platforms such as Databricks and/or Snowflake.
- Integrate data from multiple source systems and ensure data quality and reliability.
- Implement testing, monitoring, CI/CD and performance optimization.
- Work with cloud platforms such as AWS, Azure or GCP.
- Collaborate closely with Data Scientists, Analysts, Architects and business stakeholders.
- Participate in technical discussions, solution design and knowledge sharing.
- Troubleshoot and optimize existing data pipelines and data platforms.
- Minimum 6 years of experience in Data Engineering.
- Strong hands-on experience with Python and SQL.
- Strong experience with Apache Spark / PySpark.
- Experience developing ETL/ELT pipelines.
- Experience with Apache Airflow or similar orchestration tools.
- Experience with Databricks and/or Snowflake.
- Good understanding of Data Warehousing, Data Modeling and Lakehouse architectures.
- Experience with at least one major cloud platform: AWS, Azure or GCP.
- Experience with Git, CI/CD, testing and monitoring.
- Strong analytical and problem-solving skills.
- Excellent communication and stakeholder-management skills.
- Native-level German language proficiency is mandatory.
- Good English communication skills.
- Willingness to work from Bonn, Germany as required.
- Experience with Kafka or other streaming technologies.
- Experience with dbt.
- Experience with Terraform / Infrastructure as Code.
- Experience with Kubernetes/Docker.
- Experience with Data Mesh or Data Product architecture.
- Experience working in consulting or customer-facing environments.
Keywords
monthsOfExperience: 72OrchestrationApache KafkaApache SparkApache AirflowAirflowPythonSqlApache LicenseApache Http ServerCI / CDAWSGitDockerKubernetesTerraformCI/CD
Interessiert an dieser Stelle?