Skip to main content

Lead Data Engineer

Technology
Epsilon Solutions Ltd.
Vancouver, Canada1 month ago
Service contract

Job description

Lead Data Engineer

Vancouver, CA (Onsite)

Experience - 10-15 Years Data Engineering experience with 3 years of hands-on Microsoft Fabric experience

Key Responsibilities

Solution Architecture & Leadership

  • Design enterprise-scale data architecture using Microsoft Fabric components.
  • Lead technical design reviews and architecture discussions.
  • Establish data engineering standards, best practices, and governance frameworks.

Advanced Data Engineering

  • Design scalable ELT frameworks using Fabric Data Factory, Spark Notebooks, Lakehouse, Warehouse and OneLake
  • Build high-volume customer data pipelines supporting batch and near real-time processing.
  • Implement reusable ingestion and transformation frameworks.
  • Optimize large-scale workloads for performance and cost efficiency.

Data Governance & Security

  • Design data quality frameworks and monitoring solutions.
  • Implement lineage, governance, and metadata management standards.

Team Leadership

  • Mentor junior and mid-level data engineers.
  • Lead code reviews and solution governance activities.
  • Drive Agile delivery and sprint planning activities.
Keywords
monthsOfExperience: 120Apache SparkMetadata

Interested in this role?