Data Engineer

Position: Data Engineer

Location: Sydney

Contract: 6+ Months and Extendable

Must Have Skills:

Strong hands-on experience with PySpark for large-scale data processing and transformations Solid experience in Azure Data Factory (ADF) for building, scheduling, and monitoring data pipelines Proficient in SQL and relational database concepts Strong understanding of ETL/ELT pipelines, data warehousing, and data integration patterns Experience working with Azure cloud data services (ADLS Gen2, Azure SQL, Synapse preferred)

Nice to Have Skills:

Experience with Databricks and Spark optimization techniques

Exposure to DevOps / CI-CD pipelines for data engineering workflows

Familiarity with Python scripting beyond PySpark Experience working in Agile/Scrum environments Knowledge of data governance, data quality, and monitoring frameworks