Przejdź do treści głównej

Databricks Data Engineer

Technology
Wczoraj
Umowa o świadczenie usługPełni zdalna

Opis stanowiska

  • Contract B2B, 32 weeks
  • Rate: hourly
  • Full-time, typical core hours
  • Working model: remote
  • Language: English
  • Start: 1.12.2026
This role involves building and maintaining data pipelines and core data products using Databricks, ensuring they are sustainable and manageable by the engineering team.

Responsibilities

  • Build bronze, silver, and gold pipelines in PySpark and SQL to the agreed patterns.
  • Implement core data products with data contracts, tests, and documentation.
  • Make pipelines idempotent and re-runnable; handle replay, backfill, and late-arriving data.
  • Deploy through CI/CD with Databricks Asset Bundles, including unit tests and data-quality checks.
  • Tune performance and costs through Delta optimization, liquid clustering, and compute sizing.
  • Reconcile migrated data against Oracle sources.
  • Collaborate with data engineers and document everything through runbooks.

Must Haves
  • Experience with Databricks and building data pipelines.
  • Proficiency in PySpark and SQL.
  • Strong understanding of CI/CD processes.
  • Ability to implement data quality checks and tests.

Nice to Haves
  • Experience with Delta Lake and data optimization.
  • Familiarity with Oracle databases.
  • Knowledge of data governance and documentation practices.
Keywords
DatabricksPySparkSQLData Pipeline DevelopmentCI/CDData Quality TestingDelta LakeData OptimizationData ContractsData GovernanceOracleData DocumentationData ReconciliationPipeline IdempotencyBronze-Silver-Gold PipelinesData ProductsUnit TestingData-Quality ChecksDatabricks Asset BundlesDelta Optimization

Interesuje Cię ta oferta?