Data Engineer

Data Engineer - Abu Dhabi

We have a fantastic opportunity, partnered with a global investment firm in Abu Dhabi who are looking for an experienced, hands-on Data Engineer who is capable of designing, building, and operating data pipelines and models that power analytics and applications across Investment teams and Middle/Back office functions.

You will have financial markets familiarity (securities, prices, corporate actions, positions/holdings) and thrive in ambiguous environments, proactively shaping solutions, not waiting for tickets. You’ll own data end-to-end: from ingesting vendor and internal sources, to modeling in an interal lakehouse, to making data discoverable, reliable, and cost-efficient.

You’ll partner closely with BAs/PMs and quants, anticipate downstream needs, and propose pragmatic architectures that balance speed, governance, and scalability.

Responsibilities

• Participate in requirements clarification and sprint planning sessions.
• Design technical solutions and implement them, inc ETL Pipelines.
• Build robust data pipelines in PySpark
• Optimize ETL Processes
• Writing unit and integration tests.
• Support QA teammates in the acceptance process.

Essential Experience/Qualifications

• Min 5 Years of experience in IT/Data within a financial services environment
• Bachelor in IT or related field (mandatory)

Required Skills

• Exceptional logical reasoning and problem-solving skills.
• Programming: Proficiency in PySpark for distributed computing and Python for ETL development.
• SQL: Strong expertise in writing and optimizing complex SQL queries, preferably with experience in databases such as PostgreSQL, MySQL, Oracle, or Snowflake.
• Data Warehousing: Experience working with data warehousing concepts and platforms, ideally DataBricks.
• ETL Tools: Familiarity with ETL tools & processes.
• Data Modelling: Experience with dimensional modelling, normalization/denormalization, and schema design.
• Version Control: Proficiency with version control tools like Git to manage codebases and collaborate on development.
• Data Pipeline Monitoring: Familiarity with monitoring tools (e.g., Prometheus, Grafana, or custom monitoring scripts) to track pipeline performance.

Please note - this role is a permanent position based in Abu Dhabi and remote working is not an option. Relocation packages are on offer for candidates outside of the region.