Python Databricks Developer

Job title: Python Databricks Developer

Location: Plano, TX 75075 (Onsite)

Duration: 08 Months

Minimum years of experience required: 8-10 Years

Education Qualification required: BE

Detailed JD Given below

Role Objective

Python FastAPI & Databricks Developer to design, develop, and maintain scalable data and application solutions. The ideal candidate will have strong expertise in Python, FastAPI, Databricks, PySpark, SQL, and cloud-based data engineering, with experience building data pipelines, REST APIs, and analytics solutions in enterprise environments

Key Responsibilities

· Design and develop scalable REST APIs using Python FastAPI.

· Build and optimize ETL/ELT pipelines using Databricks and PySpark.

· Develop data ingestion, transformation, and processing frameworks for structured and unstructured data.

· Create and maintain Delta Lake architectures following Bronze, Silver, and Gold layer standards.

· Integrate APIs with data platforms including Azure Data Lake, Databricks, Snowflake, SQL databases, and cloud services.

· Implement data quality checks, monitoring, logging, and alerting mechanisms.

· Optimize Spark jobs for performance and cost efficiency.

· Collaborate with data scientists to operationalize ML models and data products.

· Participate in code reviews, testing, CI/CD implementation, and production support.

· Ensure adherence to security, governance, and coding standards

Required Skills & Qualifications

Technical Skills

Strong experience with Python (Advanced),FastAPI, REST API Development, Async Programming (async/await).

Hands-on experience in Databricks, PySpark, Spark SQL, Delta Lake, Data Modeling, ETL/ELT Design.

Knowledge in CI/CD automation, deployment pipelines, and DevOps practices.

Strong Expertise in stakeholder management

Qualifications

6 years of experience in Python and Databricks Skills.

Python/Databricks certifications are preferred.

Strong analytical, troubleshooting, and problem-solving skills.

Excellent communication and collaboration skills in a global delivery environment.