Senior data platform engineer
תיאור המשרה
We're looking for a Senior Data Platform Engineer to join the Data Platform team, which owns the infrastructure every data team at Lusha runs on and sits between DevOps and the Data groups. You'll be the Databricks admin (Unity Catalog, compute, governance, cost), the Confluent (Kafka) and CDC admin, and own Airflow, Elasticsearch, the databases, the data S3 estate, and the Kubernetes cluster underneath. Your job is to make the platform fast, cheap, governed, and boring: if it's broken, you fix it, if it's manual, you automate it.Hands-on experience using AI coding tools daily, and building or integrating LLM and agent tooling into real workflows, is a must for this role.This role is based in Tel Aviv.
We work in a hybrid model, with 3 days a week in the office.Requirements: 5+ years hands-on building and operating large scale data pipelines, batch and streaming, in productionDeep Spark and Databricks experience: Delta Lake, Unity Catalog, job and cluster tuning, Structured Streaming or DLTStreaming and CDC experience: Kafka (Confluent a plus), Debezium or equivalent, schema evolution and its failure modesExperience writing Airflow DAGs and operating the platform itselfExpert Python and SQL, clean, tested, performantStrong data modeling and architecture judgment, with the ability to explain tradeoffs in scale, performance, and costInfra literacy: comfortable with AWS (S3, IAM, networking basics), Terraform, Docker and Kubernetes, and CI/CDProven experience leading cross-team technical initiatives end to end, from ambiguous ask to shipped and adoptedProven experience using AI coding tools daily, with LLM and agent tooling (MCP, embeddings, vector search) built into real workflowsThis position is open to all candidates.
מתעניינים במשרה הזו?