Przejdź do treści głównej

Senior Data Engineer (Databricks)

Technology
RemoDevs
Gdynia, Polska24 000 zł - 29 000 zł /mies.3 tygodni temu
Pełny etatPełni zdalna

Opis stanowiska

Senior Data Engineer (Databricks) – Financial Services

We are looking for an experienced Senior Data Engineer to join a long-term project for a client in the financial services industry. The ideal candidate has strong hands-on experience with Databricks, modern data engineering technologies, and building scalable data solutions in enterprise environments.

Project Details

  • Position: Senior Data Engineer (Databricks)

  • Industry: Financial Services

  • Seniority: Senior

  • Start Date: December 2026

  • Duration: 12 months

  • Language: English C1

Key Responsibilities
  • Design, develop, and maintain scalable data pipelines using Databricks.

  • Build and optimize ETL/ELT processes for large-scale data processing.

  • Develop data transformation solutions using PySpark, Python, and SQL.

  • Implement and optimize Delta Lake architectures.

  • Design and maintain reliable data ingestion and integration processes.

  • Improve data quality, performance, and reliability across data platforms.

  • Collaborate with Data Architects, Analysts, and business stakeholders to deliver data solutions.

  • Ensure data security, governance, and compliance with financial industry standards.

  • Troubleshoot and optimize existing data engineering workflows.

Must-Have Requirements

  • 5+ years of commercial experience in Data Engineering.

  • Minimum 3 years of hands-on experience with Databricks.

  • Strong practical knowledge of Apache Spark and PySpark.

  • Advanced SQL and Python programming skills.

  • Experience designing and implementing ETL/ELT pipelines.

  • Solid understanding of Delta Lake and Lakehouse architecture.

  • Knowledge of data modeling, data warehousing, and data integration.

  • Experience optimizing data processing performance and managing large datasets.

  • English proficiency at C1 level.

Nice to Have
  • Previous experience in banking or financial services.

  • Experience with Azure Data Factory.

  • Experience with CI/CD pipelines and Infrastructure as Code.

  • Databricks certifications.

  • Understanding of data governance, security, and regulatory requirements in financial environments.

Keywords
Apache SparkPythonSqlApache Http ServerCI/CD

Interesuje Cię ta oferta?