AI Engineering Lead
תיאור המשרה
We're looking for an AI Engineering Lead to help drive the quality, intelligence, and continuous improvement of AI and agentic systems.This is a hands-on AI engineering lead role focused on data, evaluation, and agentic workflows. You'll build the systems and methodologies that allow us to understand how our agents perform, identify where they fail, and continuously improve their reasoning, tool usage, and outcomes.You'll work closely with AI Researchers, Engineers, and Product teams to turn experiments into reliable, high-performing AI systems - from defining evaluation datasets and metrics to improving agentic workflows and deploying them at scale.Requirements: Strong engineering experience, with a track record of owning and delivering complex technical systems.Hands-on experience building LLM-powered applications, agents, or AI systems.Strong understanding of LLM evaluation, experimentation, and data-driven development.Experience designing and implementing LLM-as-a-Judge evaluations, including evaluation criteria, scoring rubrics, structured outputs, and validation of judge reliability.Strong problem-solving skills and the ability to analyze complex AI behavior and turn observations into concrete improvements.Experience working with agentic workflows, tool calling, multi-step reasoning, or AI orchestration.Ability to work closely with researchers and engineers and bridge the gap between experimentation and production.Comfortable working in a fast-paced environment where requirements and technologies evolve quickly.Strong Advantages:Experience with LLM evaluation frameworks and automated evaluation pipelines.Proven experience with LLM-as-a-Judge methodologies, including calibrating judges against human evaluations, measuring evaluator consistency, and reducing evaluation biasExperience with LangGraph, LangChain, or comparable agent orchestration frameworks.Experience working with security, infrastructure, or other complex technical domains.Experience building production AI systems where correctness and reliability are critical.Strong Python skills and experience working with data processing and AI/ML tooling.This position is open to all candidates.
מתעניינים במשרה הזו?