Data Engineer

Job Description About the Role

We are looking for a data engineer to join our growing team. Are you passionate about the technical aspects of OUTs data landscape? See it as a challenge to build processes that are optimised to run as quick as possible, delivering quality data sets that can be reused by multiple teams.

As a data engineer within our team, you will be responsible for developing best practices and patterns, maintain our current workloads, optimize our data warehouse builds, data pipelines, and data products. The data engineer will support multiple stakeholders, including software development, actuarial, payroll and finance analytical teams.

Responsibilities

• Create best practise “formulas” that aligns with OUTs data strategy and assist the analytical teams in adopting them.
• An ideal candidate will be able to align their personal work values to the OUTsurance values of Awesome Service, Dynamic, Honest, Human, Passionate and Recognition.
• Design, build and maintain scalable and reliable data pipelines to process large volumes of data from various sources.
• Develop and maintain data models, databases, and data warehouses to support the analytic teams reporting needs.
• Ensure data quality and accuracy by implementing data validation and monitoring processes.
• Collaborate with data scientists, analysts, and other stakeholders to understand their data needs and provide solutions to support their work.
• Excellent written and verbal communication skills; with the ability to explain complex problems in a simple and effective manner.
• To design and build highly available, scalable, and fault-tolerant data infrastructure to support data processing.
• Develop and maintain infrastructure automation tools, deployment pipelines, and monitoring systems.
• Core to this is the team’s collaboration with other engineers, data scientists, and analysts to ensure the availability and performance of the data infrastructure.
• We evaluate new data technologies and tools that enhances the performance and reliability of the data infrastructure and drive adoption of these technologies within the bigger data community.
• Ability to apply industry best practices
• Ability to give input into innovative solutions
• Ability to work under pressure and tight deadlines
• Self-motivated and a self-starter
• Ability to work in a team environment
• SQL Server
• SSRS
• SSAS
• Power BI
• Apache Airflow
• Databricks
• Azure Datalake Storage
• Cosmos database
• Bachelor's degree in Computer Science, Engineering, or a related field.
• 3+ years of experience in data engineering or related fields.
• Proficiency in at least one programming language (Python, C#, etc.) and SQL.
• Proven experience with data modelling, ETL processes, and data warehousing.
• Experience with cloud platforms such as AWS, GCP, or Azure
• Understanding of data processing technologies and data management principles
• Familiarity with data technologies such as Synapse, Databricks, DeltaLake, and AirFlow