Databricks Data Engineer
Technology
Viva Tech SolutionsToronto, Canada1 month ago
Service contract
Job description
- Proven experience with Azure Databricks, including Unity Catalog and Data Lakehouse Architecture.
- Strong proficiency in PySpark and Spark SQL.
- Expertise in ETL/ELT Development.
- Experience with Azure Data Lake Storage (ADLS).
- Familiarity with Git and CI/CD practices.
- SQL Optimization and Performance Tuning skills.
- Experience in Data Migration and Reconciliation Frameworks.
- GCP BigQuery Migration Experience is essential.
Keywords
Apache SparkSqlUnityCI / CDBigQueryGitCI/CD
Interested in this role?