Data Engineer

What You'll Be Doing

• Reporting to the Data Engineering Manager as part of Data Platforms, the holder of this position will be responsible for providing expertise across a broad range of data systems operating in the Robert Walters Group IT infrastructure.

Main Responsibilities

• Design, build, implement and maintain Data Migration processes.
• Design, build, implement and maintain Data Integration and ETL/ELT pipelines.
• Design, build, implement and maintain databases (Snowflake, Dynamics, PostgreSQL, MySQL/MariaDB, Oracle, Sybase).
• Design, build and maintain solutions incorporating the company's Data Lake / Data Warehouse.
• Provide Business Level through to Technical Level analytical expertise for data-related aspects of IT projects.
• Design, build, implement and support programs and applications for database management, data management and user interaction with various data sources.
• Design and document the architectural components needed to transform raw transactional data into a consistent and coherent dataset suitable for BI use. Ensure guidelines exist for integration, lineage, cleansing and data modelling including data warehouse structures (aggregation, federation, virtualization).
• Understand the data components needed to meet business requirements including currency, quality, granularity, velocity and structure.

Required

Knowledge and Skills

• Extensive experience designing, building and maintaining Data Migration and Integration solutions using a recognized Business Integration tool, including the use of a programming language within a tool.
• Experience designing, building and maintaining databases, including procedural programming and SQL scripting on a major RDBMS.
• Experience working within the Scrum agile framework.
• Extensive experience in Data Modelling (Kimball, Star Schema, Data Vault, etc) is a must.
• Proficiency in SQL and Python programming.
  • Strong experience with Snowflake data warehousing.

• Experience with ETL/ELT tools (e.g., Airflow, dbt, AWS Glue, Dataflow).
• Hands-on experience with AWS cloud platform.
• Understanding of data modeling, data governance, and data security principles.
• Experience with version control (Git) and CI/CD pipelines for data workflows.
• Minimum of at least 5 years' experience of data engineering.

Desired

• Experience designing and building Data Lakes / Data Warehouses.
• Experience of working with NoSQL databases, e.g. MongoDB.
• AWS Certified Developer (Associate) and/or AWS Certified Solutions Architect (Associate) certifications.
• Certified Data Vault 2.0 Practitioner (CDVP2TM)
• Experience working with event-based and streaming technologies such as Apache Kafka.
• Knowledge of DataOps practices.
• Strong problem-solving and communication skills.

Key Tools & Technologies

• Languages: Python, SQL, Shell
• Cloud: AWS (Glue, S3, Lambda, State Machine, Cloudformation, etc)

Data Processing: dbt

• Databases: Snowflake, Postgres
• Version Control & CI/CD: GitHub, CircleCI

Data Modelling: Star Schema

Nice To Have

Data Modelling: Data Vault

• Cloud: Azure (Data Factory, Synapse)

DevOps: Terraform

Academic & Professional Qualifications

• University degree or Technical Diploma, preferably in an Information Technology / Information Systems subject.