Senior Data Engineer (Azure, Databricks, Airflow)

About the role

We are looking for a Senior Data Engineer to join a modern, cloud-based data platform team within a leading international tech company.In this role, you will design, build, and evolve scalable data pipelines and data products within a Lakehouse architecture on Azure , leveraging tools such as Databricks, Data Factory, and Airflow .You will work at the intersection of data engineering and platform evolution , contributing not only to building data products but also to improving the underlying platform — including metadata-driven frameworks, data quality, observability, and governance .This is a highly hands-on role with strong ownership, where you will collaborate with cross-functional teams and play a key part in shaping how data is consumed across the business.If you enjoy working in modern data environments, solving complex data challenges, and building reliable and scalable solutions — this could be a great fit.

What you'll do

Design and build scalable, reliable, and reusable data pipelines using Azure Data Factory and Apache AirflowDevelop data transformations in Azure Databricks (PySpark / SQL) following Medallion Architecture (Bronze, Silver, Gold layers)Optimize performance, cost, and reliability of data workloadsContribute to the evolution of the data platform (metadata-driven orchestration, observability, data quality)Support the migration of legacy data solutions to modern Lakehouse architectureImplement and improve data quality frameworks (e.g. Soda, Great Expectations)Ensure pipelines are observable, testable, and production-readyCollaborate with Run/Operations teams to troubleshoot incidents and ensure platform stabilityParticipate in incident management, root cause analysis, and continuous improvement initiativesContribute to data cataloging, lineage, and governance (e.g.

Unity

Catalog)

Must Have

4+ years of experience in Data Engineering / Analytics Engineering / BIStrong expertise in: Python ( PySpark ); SQL (advanced level)Hands-on experience with: Azure (Data Factory, cloud data platforms), Databricks & Delta Lake, Apache AirflowSolid understanding of: Data Lake / Data Warehouse / Lakehouse architectures, Medallion architecture, ETL / ELT design patterns, Metadata-driven approachesExperience with performance optimization, partitioning, and scalable data pipelinesUnderstanding of batch and streaming pipelinesFamiliarity with DevOps / DataOps practicesStrong problem-solving skills and ownership mindsetAbility to work with both technical and business stakeholdersFluent English

Nice to Have

Experience with Infrastructure as Code (Terraform, ARM, Bicep)Experience with CI/CD pipelines (Azure DevOps, GitHub)Exposure to Data Quality tools (Great Expectations, Soda)Experience with Data Catalogs (Unity Catalog, DataHub, Atlan, etc.)Experience with monitoring/logging tools (Grafana, Azure Log Analytics)Background in AdTech or digital environmentsExperience with BI tools (Power BI, Tableau)

Barcelona – Hybrid (2 days onsite)

Why join this project?