דלג לתוכן הראשי

Senior Data Engineer

Technology
חברה בתחום כללי
תל אביב יפו, ישראללפני חודשעד 2.11.2026
משרה מלאה

תיאור המשרה

As a Senior Data Engineer in our R&D team, you aren't just moving bytes; you are the architect of the world's most comprehensive food-intelligence engine. You will take full ownership of our ingestion pipelines, transforming massive volumes of unstructured web data into the actionable insights our customers rely on. This role requires a builder who can navigate complex anti-bot measures, design resilient distributed systems, and ensure our data remains flawless as we scale.Key responsibilities: Own end-to-end architecture and delivery of our web-scale data ingestion pipelines, from resilient scraping through transformation and storage.Design and maintain scrapers that reliably bypass anti-bot measures and handle dynamic content at scale, adapting quickly as sources change.Leverage AI coding assistants (Claude Code, Codex) to accelerate development, optimize pipeline logic, and ship faster within titling R&D cycles.Build and manage distributed, cloud-based data pipelines that support real-time analytics and AI model deployment.Proactively identify and resolve data quality issues before they reach production, ensuring accuracy and consistency across all sources.Architect scalable API and system designs that connect pipeline decisions directly to business value and consumer-trend accuracy.Monitor, troubleshoot, and continuously improve data workflows to keep the engine reliable as we scale.Requirements: 5 years of experience in Data Engineering or Backend roles focused on high-volume data processing.Experience with Airflow & DatabricksExpert-level web scraping skills: proven ability to build resilient scrapers that bypass anti-bot measures and handle dynamic content at scale.Extreme ownership: a track record of managing pipelines end-to-end and proactively fixing quality issues before they reach production.High AI-literacy: active use of LLMs and AI coding assistants (Claude Code, Codex) to accelerate development and optimize logic.Strong technical depth in distributed systems, cloud architecture, and low-latency data modeling.Data literacy: the ability to connect technical pipeline decisions to business value and consumer trend accuracy..Experience with System Design Thinking and building scalable API architectures.Please note that this position is 4 days/week in our Tel-Aviv officeThis position is open to all candidates.

Keywords
CodingMASSIVEScalabilityCloud computingNI MassiveAirflowProxy serverGNewSense

מתעניינים במשרה הזו?