Data Engineer
Technology
Toronto, Canada2 weeks ago
Service contract
Job description
- Strong hands-on experience with Azure Data Factory (ADF), Azure Databricks, Databricks Jobs, Workflows, and Notebooks.
- Expertise in PySpark, Python, SQL, Delta Lake, and ETL/ELT pipeline development.
- Experience implementing Medallion Architecture (Bronze, Silver, Gold) for enterprise data platforms.
- Develop reusable data ingestion, transformation, and orchestration pipelines.
- Implement automated data quality checks, reconciliation, testing, and performance optimization.
- Experience with Azure DevOps, Git, and CI/CD integration.
- Good to have: Unity Catalog, Databricks Asset Bundles, and Lakeflow Spark Declarative Pipelines.
Keywords
OrchestrationApache SparkDevOpsPythonSqlUnityCI/CDBig data
Interested in this role?