Skip to main content

Senior Data Engineer

Technology
TechDoQuest
Toronto, Canada1 month ago
Service contract

Job description

Job Title: Senior Data Engineer

Location: Toronto, Canada (3 Days Onsite)

Years of Experience: 7 10 Years

Responsibilities

  • Lead data analysis, profiling, discovery, and migration assessment activities.
  • Perform source to target mapping for BigQuery datasets, pipelines, and reporting assets.
  • Analyze Airflow/Composer workflows and downstream dependencies.
  • Define migration, reconciliation, and data quality requirements.
  • Collaborate with Business SMEs, Architects, and Engineering teams to validate migration outcomes.
  • Support UAT, defect analysis, data validation, and migration sign off activities.
  • Create data lineage, business rules, data dictionaries, and governance documentation.
Mandatory Skills
  • GCP BigQuery
  • Azure Databricks (mandatory)
  • Apache Airflow / Cloud Composer
  • Data Migration & Data Reconciliation
  • SQL & Data Analysis
  • Data Profiling & Data Mapping
  • Data Lineage & Data Governance
Preferred Skills
  • Strong understanding of Data Warehousing and Lakehouse concepts
  • Experience with analytics platforms
Qualifications
  • 9 years of Data Analysis experience
  • Proven experience supporting large scale cloud data migration programs
  • Strong understanding of Data Warehousing, Lakehouse, and Analytics platforms
Keywords
monthsOfExperience: 108Apache AirflowAirflowSqlApache LicenseApache Http ServerBigQuery

Interested in this role?