Databricks Data Engineer

Databricks Data Engineer

Location: Madrid, Spain - Hybrid

Contract: Initial 6 months

Day Rate: €275-€300 per day

I'm currently recruiting for a Databricks Data Engineer to join a data-focused team in Madrid.

This is a hands-on engineering role for someone with strong experience in Databricks, PySpark and Python, who can independently design, build and optimise scalable data pipelines.

Key Responsibilities

• Design and develop end-to-end data pipelines from source systems through to Gold-layer datasets
• Build scalable data processing solutions using Databricks and PySpark
• Develop robust Python-based data engineering solutions
• Implement data ingestion from multiple sources, including APIs, databases and files
• Work with Medallion Architecture - Bronze, Silver and Gold layers
• Perform data transformation using PySpark and SQL
• Process and manage large-scale datasets
• Optimise pipeline performance and Databricks workloads
• Ensure data quality, reliability and maintainability

Required Skills

• Strong hands-on experience with Databricks
• Advanced PySpark development
• Strong Python programming skills
• Strong SQL and data transformation experience
• Proven experience building end-to-end data pipelines
• Experience with data ingestion from APIs, databases, files and other sources
• Experience implementing Medallion Architecture
• Experience handling large-scale data processing
• Strong understanding of pipeline performance and optimisation
• Strong spoken and written English and Spanish language skills

Working Environment

• Hybrid working environment in Madrid
• Availability to attend the Madrid office on specific days and for important collaborative meetings