Ai Evaluation Frameworks - 2,794+ job offers

Must-Have Skills And Attributes Strong understanding of ML models, LLMs, GenAI workflows, agentic systems, and evaluation techniques. Strong foundation in machine learning concepts and model evaluation techniques. Handson experience with: Precision, Recall, Confusion Matrix, ROC/AUC, Supervised and

Hello there! Infrrd here — it’s pronounced In-fur-d. We’re an Enterprise AI company that uses AI and Machine Learning to help global organisations automate data extraction from complex documents — invoices, contracts, insurance claims, and more. Our customers are some of the world’s leading enterpri

AI Intern - Frameworks, Use Cases & Product Innovation Initial 3-month internship with the possibility of extension based on performance. Work closely with senior architects and product owners to design AI frameworks, define use cases, and develop automation prototypes using LLMs and modern GenA

Evaluate AI-generated Rust code on real PRs from major OSS projects. Write prompts for AI models. Review diffs for ownership, borrowing & safety. Complete structured evaluations (500–800 words) with evidence-backed ratings on multiple dimensions.

Job Description Description Join our mission-critical team supporting Seller Assistant, Amazon's Gen-AI powered copilot that helps sellers navigate Amazon's complex ecosystem and grow their businesses. As a Quality Assurance Specialist, you'll play a pivotal role in ensuring the reliability and accu

3+ yrs production C++ (modern C++11/14/17, STL, RAII, smart pointers). Memory management & code review exp. GDB/Valgrind skills. Git fluency, reads large codebases. Excellent English. Python required. Freelance, min 15 hrs/wk. No coursework-only.

Imagine what you could do here. At Apple, new ideas have a way of becoming outstanding products, services, and customer experiences very quickly. Bring passion and dedication to your job, and there's no telling what you could accomplish. Apple’s Sales organization generates the revenue needed to fue

Position: AI Visual Content Annotator (Arts Annotator) Type: Contractor Assignment (4 Weeks) Compensation: $7/hr Location: Remote Commitment: 40 hrs/week with some overlap with PST Role Responsibilities Evaluate and analyze AI-generated and real-world images and videos based on structured guidelines

3+ yrs production Go (goroutines, channels, interfaces, stdlib). Strong code review & testing exp. Git fluency, reads large OSS codebases. Excellent written English for technical reports. Python required. Freelance, min 15 hrs/wk. No tutorial-only.

Key Responsibilities Create and curate high quality datasets (structured & unstructured) for AI/LLM training Generate synthetic data, prompts, and golden answers Evaluate AI generated outputs for quality, logic, and accuracy Review and improve evaluation rubrics and scoring criteria Rebuild and

We’re Hiring: Arabic + English Language Experts for AI Evaluation (Remote | India) We are hiring language experts for AI Query Vetting and Evaluation workflows , contributing to enterprise-level AI systems by ensuring high standards of response quality, factuality, and safety. Project Details Perfor

This job is with Amazon, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Description Join our mission-critical team supporting Seller Assistant, Amazon's Gen-AI powered copilot that helps sel

Python Developer (AI Evaluation Frameworks) - - - - - - - - - - - Job summary We are seeking a seasoned Python Engineer with 5–7 years of professional experience and exposure to QA practices to join our team focused on development of AI evaluation frameworks. The ideal candidate combines hands‑on Py

Description Join our mission-critical team supporting Seller Assistant, Amazon's Gen-AI powered copilot that helps sellers navigate Amazon's complex ecosystem and grow their businesses. As a Quality Assurance Specialist, you'll play a pivotal role in ensuring the reliability and accuracy of AI model

DESCRIPTION Join our mission-critical team supporting Seller Assistant, Amazon's Gen-AI powered copilot that helps sellers navigate Amazon's complex ecosystem and grow their businesses. As a Quality Assurance Specialist, you'll play a pivotal role in ensuring the reliability and accuracy of AI model

Key Responsibilities JOB DESCRIPTION Create and curate high‑quality datasets (structured & unstructured) for AI/LLM training Generate synthetic data, prompts, and “golden answers” Evaluate AI‑generated outputs for quality, logic, and accuracy Review and improve evaluation rubrics and scoring cri

Job Description Description Join our mission-critical team supporting Seller Assistant, Amazon's Gen-AI powered copilot that helps sellers navigate Amazon's complex ecosystem and grow their businesses. As a Quality Assurance Specialist, you'll play a pivotal role in ensuring the reliability and accu

Rex.zone

Overview Rex.zone is hiring for entry-level STEM jobs in India supporting real AI/ML engineering workflows, including training data quality, RLHF evaluation, prompt evaluation, and QA evaluation for large language models. This is a remote, full-time role with structured workflows and calibration ses

Zensar

Key Responsibilities • Create and curate high‑quality datasets (structured & unstructured) for AI/LLM training • Generate synthetic data, prompts, and “golden answers” • Evaluate AI‑generated outputs for quality, logic, and accuracy • Review and improve evaluation rubrics and scoring criteria • Rebu

Amazon

Join our mission-critical team supporting Seller Assistant, Amazon's Gen-AI powered copilot that helps sellers navigate Amazon's complex ecosystem and grow their businesses. As a Quality Assurance Specialist, you'll play a pivotal role in ensuring the reliability and accuracy of AI model evaluations