Python Databricks Developer
Job description
Develop and maintain scalable data pipelines using Python, Databricks, and PySpark. Design and implement ETL/ELT workflows for large-scale data processing. Develop and optimize Databricks notebooks, jobs, and workflows.
Work with Apache Spark for distributed data processing. Integrate data from multiple sources and build reliable data solutions. Perform data transformation, cleansing, validation, and optimization. Troubleshoot pipeline failures and performance issues.
Collaborate with data engineers, analysts, and business stakeholders. Follow data quality, security, and development best practices. Strong experience with Python and PySpark. Hands-on experience with Databricks.
Good understanding of Apache Spark and distributed data processing. Strong SQL skills and experience with relational databases.
Experience in ETL/ELT and data pipeline development. Knowledge of cloud platforms such as Azure, AWS, or GCP.
Experience with Delta Lake and Databricks Workflows is preferred. Good problem-solving and communication skills. ---
Interested in this role?