Data Engineer

Requirements

Must have:

- Proficient in Java, with exposure to Python, Flink, Kafka, or Spark - Experience in building, optimizing, and maintaining scalable data pipelines - Knowledge of AWS managed services such as Kinesis, MSK, Lambda, and Glue - Understanding of data modeling and architecture best practices - Familiarity with CI/CD tooling (e.g., Azure DevOps, GitHub Actions, Jenkins) - Experience with Infrastructure as Code tools (e.g., Terraform, CloudFormation) - Exposure to container technologies like Docker and Kubernetes - Strong collaboration skills, with the ability to work closely with analytics, ML/AI, and product teams - Ability to guide junior engineers and participate in knowledge-sharing sessions - Satisfactory BPSS and SC security clearance, including UK address history and valid passport status

Responsibilities:

- Design, build, and maintain scalable data solutions for analytics and AI - Create robust data pipelines and ensure data reliability - Develop and support real-time streaming pipelines and event-driven integrations - Integrate data from multiple sources, including streaming and batch - Contribute to data modeling and architecture best practices - Apply data quality, lineage, governance, and security controls consistently - Deploy and maintain data applications using CI/CD tooling - Manage cloud environments using Infrastructure as Code - Work with container technologies and Kubernetes-based workloads - Deliver clean, well-structured datasets in collaboration with analytics and product teams

Company:

We are a forward-thinking company based in the Advanced Technology Centre at Newcastles Cobalt business park. Our team is engaged in delivering high-quality data and technology services to both public and private sector clients.

We offer a collaborative culture that champions diverse thinking and continuous learning, providing opportunities for career growth within our global network of experts. Our hybrid working model allows you to thrive both in-office and remotely, ensuring a dynamic and flexible work environment.