Data Engineer (Python/SQL)

Job Responsibilities:

• Perform ETL (Extract, Transform, Load) processes on large and complex transaction datasets to support business reporting, modelling, and analytical needs.
• Develop, maintain, and optimise data processing pipelines for data modelling, analysis, and business intelligence.
• Work with relational and distributed databases to extract, transform, process, and manage large volumes of data efficiently.
• Write and optimise SQL queries and data processing scripts to ensure data accuracy, performance, and reliability.
• Support the development of batch and streaming data pipelines for big data processing and analytics.
• Collaborate with business stakeholders and cross-functional teams to understand data requirements, conduct analysis, and deliver effective data solutions.

Job Requirements:

• Bachelor's degree in Computer Science, Information Technology, Data Science, or a related technical field.
• Open to fresh graduates or candidates with up to 1 year of relevant working experience in data analysis, data engineering, or a related field.
• Good understanding of relational databases and distributed database systems.
• Familiarity with Python or Java, SQL, HiveQL, and/or SparkSQL.
• Basic understanding of SQL query optimisation, performance tuning, and data processing best practices.
• Good analytical and problem-solving skills, with an understanding of batch and streaming data pipeline concepts.