Model Evaluation jobs in Redmond

Python Infrastructure Engineer — Model Evaluation (AI Training) About The Role What if your Python expertise could directly shape the systems that power next-generation AI models? We're looking for a senior Python engineer to design and build the data pipelines, evaluation harnesses, and annotation

In accordance with Washington state law, we are highlighting our comprehensive benefits package, which is available to all eligible US based employees. Benefits for this role include: Health, dental, vision, life, disability insurance Retirement Benefits: 401(k) with company match Paid Time Off: 20

YO IT Consulting

A fast-growing AI data services company is seeking a Senior C Engineer to work remotely on an hourly basis. In this role, you will review AI-generated C code, while creating high-quality references and assessing solutions for clarity and accuracy. The ideal candidate should have a Bachelor's degree

L&T Technology Services

$90,000 - $140,000 /year

Job Description: Build and optimize data pipelines and analytics workflows leveraging Snowflake and Python Develop AI‑powered applications and internal tools using frameworks like LangGraph and LangSmith Integrate and operationalize LLM workflows, agents, and observability for AI systems Leverage mo

Turing

A leading technology firm is seeking finance experts to enhance AI models. Responsibilities include evaluating performance in capital markets and creating assessment rubrics. Candidates should have 2+ years in finance fields like investment banking and possess strong financial knowledge. This remote

Weekly Hours: 40 Role Number: 200637211-3337 Summary Do you get excited by building AI applications to enhance the evaluation of various Apple AI products? Our Evaluation organization is responsible for providing principled assessments across a diverse range of Apple features, from Search and Siri t

Overview The Microsoft Research AI Frontiers Lab is on a mission to push the boundaries of what's possible in Artificial Intelligence (AI) — advancing capabilities, efficiency, and safety through breakthroughs in agentic model and systems. Our previous work spanned Small Language Models (Phi, Orca),

Apple

Role Number: 200620241-3337 Summary Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other’s ideas stronger. That happens becau

ByteDance

Responsibilities About the team The Seed Infrastructures team oversees the distributed training, reinforcement learning framework, high-performance inference, and heterogeneous hardware compilation technologies for AI foundation models. Responsibilities Design and build scalable infrastructure for l

AIML - Sr Engineering Program Manager, Apple Intelligence and Model Evaluation Apple | Posted Feb 14 Full-time Seattle Summary Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store exper

A leading AI consultancy is seeking individuals to evaluate AI-generated coding outputs, ensuring technical accuracy and clarity. Candidates should hold a degree in Computer Science and possess substantial software engineering experience. Responsibilities include fact-checking AI outputs, assessing

About mpathic.ai Keeping the human in AI. mpathic is a trusted leader in advancing quality and safety in AI systems through expert-led evaluation and human data. We partner with leading technology companies to support red teaming, trust & safety, expert annotation, and model evaluation across high-s

Allen Institute

$167,800 - $209,700 /year

AI Research Scientist II – Office of the CTO The mission of the Allen Institute is to unlock the complexities of bioscience and advance our knowledge to improve human health. Using an open science, multi-scale, team-oriented approach, the Allen Institute focuses on accelerating foundational research

*Who are we?** Our mission is to scale intelligence to serve humanity. We’re training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumen

YO IT Consulting

Contract Remote Role Description Fast-growing AI data services company and subsidiary of, is seeking mathematicians to join our AI training project. In this role, you will review AI-generated responses, evaluate the reasoning quality and step-by-step problem-solving, and provide expert feedback that

About mpathic.ai Keeping the human in AI. mpathic is a trusted leader in advancing quality and safety in AI systems through expert-led evaluation and human data. We partner with leading technology companies to support red teaming, trust & safety, expert annotation, and model evaluation across high-s

Overview Do you enjoy solving problems, looking at problems through a different lens, and working closely with customers to innovate new solutions to complex problems? Do you jump with excitement at the opportunity to identify trends and provide unique business solutions? Do you want to join a team

Amazon

$142,800 - $193,200 /year

The GRAISE team (Grocery, Retail & In-Store Experience) within Worldwide Grocery Store Tech (WWGST) builds foundational AI and machine learning systems that power Amazon's in-store grocery technologies. We develop domain-specific models that solve uniquely complex challenges in grocery — from smart

Are you excited to tackle some of the most ambitious technical challenges in Apple Intelligence? Be involved in collaborating closely with our machine learning researchers, engineers, and data scientists? Together, you will orchestrate groundbreaking research initiatives and develop transformative p

Amazon's Last Mile Geospatial Science team leverages sate of the art computer vision, generative AI, and deep learning to enhance vehicle navigation and ensure safe, efficient deliveries by enriching map data from billions of satellite, aerial, and street-level images and videos. The role involves b