Skip to main content

Data Engineer (Senior) (Python Coding + AI/ML frameworks + HTML + CSS+ Angular + JavaScript + AWS services + Git & GitHub Actions + UI/UX principles)

Technology
Abalobi Solutions
Johannesburg, South Africa1 months agoUntil 2026/10/18
Full timeFully remote

Job description

Introduction

An exciting opportunity is available for an experienced Senior Data Engineer to join a globally focused technology team delivering enterprise-scale data and cloud solutions. You will work on modern data platforms, AI-driven initiatives, and cloud-native applications while collaborating with cross-functional teams in an Agile environment.

This role is ideal for a data engineering professional who enjoys solving complex business problems, designing scalable solutions, and working with cutting-edge technologies in cloud computing, AI, and modern software engineering.

Key Responsibilities

  • Gather and translate business requirements into technical solutions.
  • Define project scope and align business and technical stakeholders.
  • Design, develop and maintain scalable data pipelines and ETL processes.
  • Build AI-enabled solutions and support the full software development lifecycle.
  • Develop and maintain cloud-native applications on AWS.
  • Collaborate with engineering teams to deliver high-quality technical solutions.
  • Build secure, scalable and high-performing applications.
  • Document solution designs, APIs and technical specifications.
  • Resolve production issues and support onboarding of new data use cases.
  • Ensure solutions meet business requirements, quality standards and delivery timelines.
  • Take ownership of deliverables and contribute to continuous improvement initiatives.

Essential Requirements

  • Relevant IT, Computer Science, Engineering or Business Degree.
  • Strong Data Engineering experience.
  • Python development.
  • ETL/Data Ingestion development.
  • Apache Kafka.
  • Apache Spark.
  • Experience with AI/ML frameworks such as LangChain, LangGraph or GAIA.
  • Ability to translate business requirements into technical specifications.
  • Experience defining acceptance criteria and managing technical scope.
  • Front-end development experience using HTML, CSS, JavaScript/TypeScript, Angular or React.
  • Unit testing using Jest and/or pytest.
  • AWS Cloud services including:
    • API Gateway
    • Lambda
    • DynamoDB
    • S3
    • SQS
  • Git version control.
  • GitHub Actions for CI/CD.
  • RESTful APIs and/or GraphQL.
  • Understanding of UI/UX principles.
  • Excellent communication and stakeholder engagement skills.
  • Experience working within Agile delivery environments.

Advantageous skills

  • Passion for Artificial Intelligence and Large Language Models (LLMs).
  • Strong analytical and problem-solving skills.
  • Ability to learn new technologies quickly.
  • Team-oriented mindset with excellent collaboration skills.
  • Experience working within multinational environments.
  • Strong presentation and communication skills.
  • Excellent organisational and interpersonal skills.
  • Ability to manage multiple priorities and deliver high-quality work.
  • International project exposure.
  • Willingness to travel internationally when required.

Qualifications

Interested in this role?