Python Data Science

Role Purpose The Data Engineer builds, optimises, and maintains scalable data pipelines across Aviva's cloud and big data ecosystems. Key Responsibilities

• Build ETL/ELT pipelines in Python, PySpark and Airflow. - Implement AWS data patterns: S3, Glue, Lambda, EMR, Kinesis, Redshift. - Deliver scalable, production‑grade transformations. - Ensure data quality, lineage, validation and monitoring. - Collaborate with architects, analysts, data scientists. Skills & Experience
• Strong Python (Pandas), PySpark and Airflow DAG creation. - Large‑scale data engineering experience. - AWS engineering experience or cloud equivalents. - Strong SQL and data modelling. Nice to Have
• Snowflake, DBT, Redshift experience. - Kafka, Terraform, CI/CD, containerisation.