Databricks Developer

Job Description

Key Responsibilities

Develop and maintain ETL/ELT data pipelines using PySpark and SQL within the Databricks platform.

Design, create, and optimize Delta Lake tables to support scalable and high-performance data processing.

Build and manage Databricks Workflows jobs to orchestrate and automate data pipelines.

Write and execute unit tests to ensure code quality, reliability, and maintainability.

Investigate and resolve data quality issues, ensuring the accuracy and integrity of data assets.

Produce clear technical documentation for developed solutions, processes, and pipeline configurations.

Participate in peer code reviews and incorporate feedback to maintain coding standards and best practices.

Required Qualifications

5 years of experience in Data Engineering, including 3+ years of hands-on experience with Databricks.

Strong proficiency in PySpark and SQL.

Working knowledge of Delta Lake and at least one major cloud platform (Azure, AWS, or GCP).

Familiarity with Git-based source control and CI/CD practices.

Ability to independently deliver well-defined technical solutions from development through deployment.

Preferred Qualifications

Databricks Data Engineer Associate Certification (preferred).

Experience working within established data platform and engineering best practice frameworks.

Strong troubleshooting and problem-solving capabilities.