Skip to main content

Data Engineer

Technology
MSR Technology Group
Toronto, Canada2 weeks ago
Service contract

Job description

  • Strong hands-on experience with Azure Data Factory (ADF), Azure Databricks, Databricks Jobs, Workflows, and Notebooks.
  • Expertise in PySpark, Python, SQL, Delta Lake, and ETL/ELT pipeline development.
  • Experience implementing Medallion Architecture (Bronze, Silver, Gold) for enterprise data platforms.
  • Develop reusable data ingestion, transformation, and orchestration pipelines.
  • Implement automated data quality checks, reconciliation, testing, and performance optimization.
  • Experience with Azure DevOps, Git, and CI/CD integration.
  • Good to have: Unity Catalog, Databricks Asset Bundles, and Lakeflow Spark Declarative Pipelines.

Keywords
OrchestrationApache SparkDevOpsPythonSqlUnityCI/CDBig data

Interested in this role?