Databricks PySpark Developer

Role Summary :

We are looking for an experienced Databricks PySpark Developer to design, develop, and enhance scalable data pipelines.

The role requires strong hands-on expertise in PySpark and Databricks, along with experience working on cloud data platforms and ETL solutions.

Key Responsibilities :

• Design, develop, and maintain scalable data pipelines using Databricks and PySpark
• Understand existing data pipelines and implement enhancements based on project requirements
• Develop robust ETL/data processing workflows
• Collaborate with technical leads, data engineers, product managers, and business stakeholders
• Translate business requirements into effective technical solutions
• Troubleshoot, optimize, and improve data pipeline performance
• Work with distributed data processing and cloud-based data platforms
• Independently manage assigned development activities and deliver within timelines
• Provide regular updates on development progress and technical deliverables

Mandatory Skills :

• 5 - 7 years of relevant IT experience
• Strong hands-on experience with PySpark
• Strong hands-on experience with Databricks
• Good experience in ETL/Data Engineering
• Experience with at least one Cloud Data Platform
• Experience with Kafka / Pub-Sub for streaming data processing
• Experience with Apache Airflow for data pipeline orchestration
• Strong understanding of data engineering concepts

Good to Have :

• Experience with GCP
• Hands-on experience with GCP Data Services
• Experience in the Healthcare domain
• Experience working with large-scale data processing and cloud data pipelines

Candidate Profile :

• Strong problem-solving and analytical skills
• Good communication and stakeholder collaboration skills
• Ability to work independently with minimal supervision
• Comfortable collaborating with teams across India and the US