Software Engineer - Data Ingestion

We are seeking engineers with hands-on experience in developing and managing distributed systems and microservices in a production environment. The ideal candidate should have a solid background in infrastructure and operations.The team builds high-throughput ingestion and processing pipelines, efficient storage on object stores, and systems for data governance, usage reporting, and routing data to multiple physical locations.You will work on cloud-native, production systems written in Rust and Scala, operating at scale with Kafka, Postgres, Redis, and object storage, run on Kubernetes and operate in a multi-cloud environment.Responsibilities:Develop and operate distributed systems in productionBuild Kafka-based ingestion and processing pipelinesDesign systems for data governance, retention, deletion, and usage reportingWork with Postgres and Redis, requiring solid database design and operational knowledgeImplement efficient persistence using column-oriented data formats and object storage.Requirements: Located in Israel5+ years of software development experienceProduction experience with large-scale Apache Kafka or comparable distributed data streaming platformsStrong understanding of distributed systems, databases, and production operationsExperience with Scala or Rust or other JVMB.Sc. in Computer Science or an equivalent fieldAdvantages:Experience with Kafka Streams or similar frameworksExperience with column-oriented data formats and large-scale analytical storage systemsExperience with Apache Arrow and DataFusion.This position is open to all candidates.