Data Engineer
תיאור המשרה
We're looking for a Data Engineer with 4 year experience to join our Data Engineering team and help us build and scale our production-grade data platform. You'll work on high-performance systems built on self-hosted ClickHouse, optimize complex data pipelines, and collaborate closely with Product, Analytics, and Infrastructure teams to deliver reliable, fast, and scalable data solutions.This is a hands-on technical role where you'll have a significant impact on how we ingest, model, store, and serve data that powers our analytics and AI-driven products.Youll play a key role in shaping the direction of our data platform and have meaningful ownership over critical components of our architecture.What You'll Do:Data Modeling &
- ArchitectureDesign and evolve data models that reflect business logic and support analytical use casesCollaborate with the BI and Analytics teams to understand data requirements and translate them into efficient schemasPerformance OptimizationOptimize ClickHouse schemas, partitioning strategies, indexing, and compressionProfile and tune slow queries to improve performance and reduce costsImplement systems that ensure data quality, consistency, and operational efficiency (e.g., deduplication, validation, anomaly detection)Monitor pipeline health, data freshness, and query performance with appropriate alerting mechanismsSQL Compiler DevelopmentDevelop and maintain the SQL Compiler layer that translates high-level queries into optimized ClickHouse execution plansImplement query optimization and rewriting strategies to improve performanceDebug and resolve compiler issues to ensure accurate and efficient query translationData Pipeline Development &
- CollaborationReview and advise the Integration team on pipeline architecture, performance, and best practices.Provide guidance on data modeling, schema design, and optimization for new data sources.Troubleshoot and maintain existing pipelines when issues arise or optimization is neededEnsure data freshness, reliability, and quality across all ingestion pipelines.Collaboration &
- SupportWork closely with the Integration team to ensure smooth data ingestion from new sources.Partner with Infrastructure to support high availability and disaster recoverySupport other teams across the company in accessing and using data effectively.Requirements: Excellent communication and collaboration skillsEnglish at a high level, written and spoken requiredAbility to work from our Jerusalem office (located in the Central Bus Station next to the train) 2 times a week (Monday &
- Wednesday) is requiredStrong attention to detail, ownership mentality, and ability to work independentlyQuick learner who can dive into new codebases, technologies, and systems independentlyHands-on mentality - not afraid to roll up your sleeves, dig into unfamiliar code, and work across the stack (including backend when needed)4 years of experience as a Data EngineerStrong problem-solving skills for complex data challenges at scale - ability to debug performance issues, data inconsistencies, and system bottlenecks in high-volume environmentsExperience with data modeling and schema design for analytical workloadsStrong proficiency in SQL and experience with complex analytical queriesHands-on experience building and maintaining data pipelines (ETL/ELT)Ability to troubleshoot and optimize systems handling large data volumes (millions rows, complex queries, high throughput)Knowledge of query optimization techniques and execution planningFamiliarity with columnar databases (ClickHouse, BigQuery, Redshift, Snowflake, or similar). Columnar DB experience is a big plus.This position is open to all candidates.
מתעניינים במשרה הזו?