Skip to main content

Data Engineer – Azure Databricks / Data Modeling

Technology
Confiar Services
Toronto, Canada1 month ago
Service contract

Job description

Data Engineer – Azure Databricks / Data Modeling / Data Lineage

Location: Toronto Canada

Contract: Long-Term Contract

Job Summary

We are looking for a Data Engineer with strong hands-on experience in Azure Databricks, Data Modeling, Data Lineage, Metadata Management, and Data Engineering. The ideal candidate will help build scalable and standardized enterprise data lineage solutions by consolidating existing proof-of-concepts into production-ready platforms.

Key Responsibilities

  • Develop and enhance scalable data engineering solutions using Azure Databricks.
  • Design and implement conceptual, logical, and physical data models.
  • Develop and maintain data lineage models and lineage metamodels.
  • Transform existing data lineage POCs into standardized, enterprise-grade solutions.
  • Work closely with Data Architects, Data Engineers, Data Governance, and Data Management teams.
  • Define and implement enterprise data lineage standards, frameworks, and technical solutions.
  • Support metadata management, data integration, lineage, and data governance initiatives.
  • Analyze data flows across multiple platforms and document end-to-end lineage.
  • Build scalable solutions for capturing, managing, and consuming technical and business metadata.
  • Ensure data solutions follow enterprise architecture, governance, security, and quality standards.
  • Troubleshoot data pipeline and lineage-related issues and improve solution performance.
  • Contribute to modernization and standardization of enterprise data platforms.
Required Skills
  • Strong hands-on experience with Azure Databricks and modern data engineering.
  • Strong knowledge of Data Modeling and enterprise data architecture concepts.
  • Strong understanding of Data Lineage and Lineage Metamodels.
  • Experience designing metadata and lineage solutions.
  • Experience converting POCs/prototypes into scalable production solutions.
  • Strong understanding of data platforms, metadata management, data integration, and data governance.
  • Strong SQL and data transformation skills.
  • Experience working with large-scale enterprise data environments.
  • Strong communication and collaboration skills.
Keywords
MetamodelingMetadataCross-platform softwareSqlData management

Interested in this role?