Job description
Job highlights
- Platform services: design,build and run the backend services that receive events,track cases,decide whether an agent should run,and resume work when a person responds
- Required qualifications
- . You should be comfortable reading and making changes in the language you use less
- 3+ years of production experience in your primary backend language
Responsibilities
- Platform services: design, build and run the backend services that receive events, track cases, decide whether an agent should run, and resume work when a person responds.
- Correctness: own the platform's correctness guarantees:
- idempotency;
- deduplication of repeated signals;
- locking against concurrent runs;
- recovery from crashed or stuck runs;
- a complete audit trail of what each agent did.
- Agents: build and evolve agents that follow business SOPs. Decide which steps belong in deterministic code, which need the models' judgement, and which must stay with a person.
- Tools: build MCP tool servers that give agents safe, well-described access to internal data and services, with clear input and output schemas.
- Human-in-the-loop: integrate approval flows: request approvals, verify signed callbacks, handle partial approval, rejection and expiry, and make sure only approved work is executed.
- Evaluations: write evals for agents and tools (golden datasets, regression suites, trace review) and use them as the gate for shipping prompt, model and tool changes.
- Observability and cost: instrument services and agents with tracing, metrics and logs. Track model cost per case, and keep agents from running when nothing has changed.
- Safety: apply guardrails, including:
- treating external content as untrusted input;
- keeping money and policy rules in code, not in prompts;
- never automating systems Pattern policy forbids.
- Cross-team work: make changes across service boundaries with the teams that own sensors, task management, approvals and the Pi web app, including in a second language (Python or Ruby on Rails) when the work requires it.
- Requirements: translate business requirements (SOPs, approval rules, escalation paths) into clear designs, tickets and runnable systems.
- Production support: support production, including on-call triage when an automation misbehaves.
- Leadership (Senior): mentor other engineers, review their designs and code, and help set engineering standards for AI work on the team.
What we expect
- 3+ years of production experience in your primary backend language.
- Designs new components end to end, such as the case-tracking service, and takes ambiguous problems to a clear design.
- Owns a production service, including being on call.
- Has shipped and measured an LLM-powered feature they owned.
- Mentors engineers and reviews designs and code.
Required qualifications
- Bachelors degree in Computer Science, Information Technology, a related field, or equivalent professional experience.
- 5-7 years of professional software engineering experience, mostly on backend systems.
- Primary skill set (one of the following):
- TypeScript and Python , with production experience in TypeScript (3+ years) and solid working experience in Python; or
- TypeScript and Ruby on Rails , with production experience in either (3+ years) and solid working experience in the other.
- You should be comfortable reading and making changes in the language you use less.
- Experience designing APIs and webhooks, including authentication and signature verification.
- Has shipped at least one LLM-powered feature in production: tool or function calling, structured outputs, and a way to measure whether it works.
- Comfort with AWS (ECS or containers, S3, IAM at minimum) and with Docker.
- Production ownership, monitoring, alerting, incident response and root-cause analysis.
- Excellent engineering practice: version control, code review, automated testing, and small, reviewable changes.
Keywords
planning-and-designvisual-art-designproduct-development-and-designtrade-shows-eventsartificial-intelligencedata-deduplicationrepair-and-recoveryauditsaudit-trailstandard-operating-procedure-sopmicrosoft-certificationmodel-context-protocol-mcphuman-in-the-loop-hitlobservabilityenvironment-health-and-safety-hsseguardrailsracking-protectionsafety-barrierssensors-test-measurementsensors-feedback-devices
Interested in this role?
