Data Engineer - Python and AWS
Functieomschrijving
Description:
The Expertise Center Market Analysis (EC MA) delivers fundamental analysis and economic research on energy markets to support trading and portfolio management.
Operating in a fast-paced trading environment, the team combines deep energy market expertise with quantitative analysis and data science to provide key insights.
In this context, a data platform for time series management has been implemented. This platform addresses key challenges related to scalability, access to high-quality data, data discoverability and data governance.
The platform is built on a modern data architecture and supported by a core team of data experts, working in an agile framework with business stakeholders and the Data Office. The team is looking to strengthen its capabilities to support platform expansion.
Key responsibilities:
- Develop and maintain scalable data pipelines and services on AWS using Python.
- Ensure data quality through validation, cleansing, standardization, and monitoring.
- Manage data governance, metadata, and data lifecycle processes.
- Support onboarding users, providing training, and resolving data-related issues.
- Ensure data reliability, discoverability, and operational excellence.
- Collaborate with business stakeholders and the Data Office to continuously improve the platform and its capabilities.
Required skills:
- Strong Data Engineering experience with Python and AWS.
- Strong background in Data Management, Data Quality, and Data Governance.
- Experience with data integration, monitoring, and production support.
- Excellent communication and stakeholder management skills.
- Analytical mindset and user-oriented approach.
Interesse in deze functie?