- We require 2+ years of experience in backend engineering, AI automation, or complex systems integration.
We require proven ability to build and maintain production-grade software with modular separation, such as distinct services for data parsing, logic processing, and reporting.
We require strong command of at least two major languages, such as Python, JavaScript, Go, or Java, and experience working with SQL databases.
We require practical experience building for live, non-mocked environments and handling multi-turn system interactions.
We require outstanding attention to detail and the ability to provide clear, high-density technical feedback on complex system behaviors.
Nice to have: experience building multi-stage coordination tasks where data acquisition leads to reasoned output.
Nice to have: hands-on experience integrating agents with live tools such as Supabase, Gmail, and various APIs to solve real-world problems.
Nice to have: comfort implementing persistent state and session discovery using MEMORY.md to track agent progress.
Nice to have: experience identifying subtle failures like privacy leaks, authority escalation, or indirect prompt injections.
Responsibilities:
- We help train AI systems and agents by providing human feedback on their behavior.
We collaborate with leading AI organizations to train large language models to function as proactive, multi-step agents.
We design, coordinate, and optimize complex real-world architectural workflows.
We support the training of advanced generative systems to improve autonomous agent performance.
We evaluate agent behavior in live environments and provide clear technical feedback on complex system interactions.
We identify subtle system failures and edge cases, including privacy leaks, authority escalation, and prompt injection risks.
Company:
We are Outlier, and we help the worlds most innovative companies improve their AI agents through human feedback. Our projects focus on training large language models to act as proactive, multi-step agents that can design, coordinate, and optimize complex real-world workflows. We are looking for passionate orchestration experts and experienced software developers who want to help us train some of the worlds most advanced generative systems.
