Data Engineer
Technology
Singapore, Singapore1 week ago
Full time
Job description
What you'll be doing
- Develop, maintain and optimise data pipelines using Python, PySpark and SQL across Cloudera, Snowflake and Databricks platforms.
- Perform data extraction, cleansing, transformation and loading (ETL) using Informatica and other data integration tools.
- Support batch data processing and enterprise data integration to ensure data accuracy, quality and consistency.
- Monitor, troubleshoot and resolve data pipeline failures, performance bottlenecks and data discrepancies.
- Collaborate with Senior Data Engineers and reporting teams to deliver reliable datasets for business analytics and reporting.
Requirements
- Bachelor's degree in Computer Science, IT, Data Engineering or related disciplines.
- Minimum 3 years of experience in Data Engineering, ETL Development or Data Integration.
- Strong hands-on skills in Python, PySpark and SQL.
- Practical experience with Informatica and ETL/ELT development.
- Experience with at least one of the following platforms: Cloudera, Snowflake or Databricks.
- Good understanding of data pipelines, batch processing, data transformation and data quality management.
- Strong analytical, troubleshooting and problem-solving skills.
Keywords
PythonSql
Interested in this role?