Databricks Developer - Data Engineering

Job Summary:

We are looking for an experienced Databricks Developer with strong expertise in Python, SQL, and Databricks to develop scalable data solutions, build curated datasets, and support self-service analytics using Databricks Genie and AI/BI capabilities.

Key Responsibilities:

• Develop modular Python applications, reusable utilities, APIs, and scalable data solutions on Databricks.
• Build and maintain curated datasets and semantic layers using Databricks SQL and Unity Catalog.
• Configure and optimize Databricks Genie/AI-BI spaces to enable natural-language querying and self-service analytics.
• Manage metadata, instructions, and data definitions to improve the accuracy and quality of natural-language queries.
• Develop and optimize SQL queries and data processing workflows.
• Work with Apache Spark and PySpark for data transformation and processing.
• Implement data governance, access controls, and security best practices using Unity Catalog.
• Debug technical issues, troubleshoot data pipelines, and optimize application and query performance.
• Collaborate with data engineers, analysts, and business stakeholders to deliver reliable data solutions.

Required Skills:

• 5+ years of experience in Python development and data engineering.
• Strong proficiency in Python, SQL, and Databricks.
• Hands-on experience with Databricks SQL and Unity Catalog.
• Experience building APIs, reusable Python modules, and data processing solutions.
• Knowledge of Apache Spark/PySpark and data transformation techniques.
• Exposure to Databricks Genie, AI/BI spaces, and natural-language query configuration.
• Understanding of data governance, metadata management, debugging, and performance optimization.
• Strong analytical, problem-solving, and communication skills.