Google Cloud Platform - GCP Data Engineer
Technology
Brussels, België4 weken geleden
Voltijd
Functieomschrijving
Contribute to the major transformations of companies and public actors by combining technological innovation and business expertise, serving our society and customers to help them move forward sustainably.
Your challenges for this function:
- Design, develop, and maintain robust and efficient data pipelines (ETL/ELT)
- Manage and optimize databases (SQL and NoSQL) to ensure data availability and integrity
- Implement Big Data solutions using technologies such as Hadoop, Spark, and Kafka
- Collaborate with Data Science and Business Intelligence teams to understand business needs and deliver ready-to-use data
- Ensure data quality, security, and compliance (GDPR, anonymization).
- Contribute to defining data architecture and implementing cloud solutions (AWS, GCP, Azure)
- Automate processes and optimize the performance of data processing systems
- Master in computer sciences / Business or equivalent experience
- Excellent command of Python and SQL
- Knowledge of relational databases (PostgreSQL, MySQL) and NoSQL databases (MongoDB, Cassandra)
- Experience with pipeline orchestration tools such as Apache Airflow and Luigi
- Strong command of Big Data technologies: Apache Spark, Hadoop, and Kafka.
- Cloud computing skills with a strong focus in Google Cloud Platform
- Strong hands-on knowledge of data flows and data preparation techniques
- Knowledge of relational databases including SQL Server and analytics
- Notions in data visualization solutions and techniques
- Practical experience with Agile
Keywords
OrchestrationApache HadoopApache KafkaApache SparkApache CassandraMongodbCloud computingApache AirflowAirflowMysqlPostgresqlPythonSqlHadoopApache LicenseApache Http ServerCassandraRelational grammarBig dataAWS
Interesse in deze functie?