Databricks Architect (Data Engineering)
SpyrosoftOpis stanowiska
About the roleWe are looking for an experienced Databricks Architect to design and lead modern data platforms built on the Databricks ecosystem. In this role you will define architecture standards, establish engineering best practices, and support development teams in delivering scalable, secure and high-performing data solutions.ResponsibilitiesDesign end-to-end Data Lakehouse architectures based on DatabricksDefine data platform architecture, integration patterns and governance standardsLead architecture decisions around ETL/ELT, batch and streaming data processingDesign scalable solutions using Delta Lake, Unity Catalog and Medallion ArchitectureCollaborate with Data Engineers, Data Scientists, Architects and business stakeholdersDefine security, data governance and access management strategiesOptimize platform performance and cloud costsSupport CI/CD implementation and Infrastructure as Code practicesReview solution designs and mentor engineering teamsDrive adoption of modern Data Engineering best practicesRequirements7+ years of experience in Data Engineering3+ years of hands-on experience with DatabricksStrong expertise in Apache Spark (PySpark and/or Spark SQL)Excellent knowledge of Delta Lake and Lakehouse ArchitectureExperience designing enterprise-scale data platformsStrong understanding of Medallion ArchitectureExperience with Unity Catalog and data governanceExperience with cloud platforms (Azure, AWS or GCP)Knowledge of orchestration tools (Azure Data Factory, Airflow, Databricks Workflows or similar)Experience with CI/CD pipelines and Git-based developmentStrong SQL and Python skillsExcellent communication and stakeholder management skillsFluent EnglishNice to haveDatabricks certificationsExperience with dbtExperience with Kafka or other streaming technologiesTerraform or other IaC toolsExperience designing AI/ML-ready data platformsGerman language level C1/C2 or native
Interesuje Cię ta oferta?