Yash Paliwal
AI Quality Analyst and Data Annotation Specialist
Hire this person
Send a job offer directly to this candidate
About
Detail-oriented AI Quality Analyst and Data Annotation Specialist with over 3 years of experience delivering accurate evaluation, labeling, and quality assurance across AI, multimedia, and e-commerce projects. Experienced in working with LLM prompt-response evaluation, audio and time series data annotation, and content moderation for global AI companies including Turing, Centific, Scale AI, Appen, and Telus International. Known for strong analytical thinking, clear written communication, and consistently meeting quality benchmarks in fast-paced remote contract environments.
Experience
AI Quality Analyst at Turing (2025-12 – Present)
- Evaluated AI prompt-response pairs in Google Colab, reviewing JSON-formatted outputs for factual accuracy, logical consistency, and instruction-following quality.
- Designed realistic and adversarial test prompts to assess how the AI model handled complex, ambiguous, and everyday user scenarios.
- Authored detailed written justifications for each quality assessment, clearly identifying failure points in AI responses using structured, professional language.
Specialist Analyst at Centific (2025-07 – 2025-12)
- Annotated audio data by labeling sounds and marking timestamps per client requirements, supporting AI model development for a leading audio application.
- Annotated time series data with consistent labeling to aid accurate pattern recognition in model training.
- Documented detailed notes within the client annotation tool, flagging unclear audio segments and inconsistencies to maintain dataset quality.
Freelance Media Analyst at Appen (2025-04 – 2025-06)
- Executed media data analysis with accurate annotation of video, photo, and song content.
- Reviewed and evaluated media content for compliance with client guidelines.
- Maintained thorough documentation of findings and recommendations for future reference.
Freelance AI Trainer at Scale AI & Outlier (2024-01 – 2025-04)
- Evaluated API response outputs from a quality, logical, and user-experience perspective, ensuring accurate formatting without requiring technical back-end intervention.
- Applied structured grading rubrics to identify logical flaws, hallucinations, and inconsistencies in text-based AI generation.
- Maintained a high standard of precision in human-in-the-loop training, acting as a critical checkpoint for quality control across multiple AI projects.
Freelance Data Reviewer at Telus International (2023-08 – 2023-10)
- Reviewed and validated product images and e-commerce pages for accuracy and compliance with platform guidelines.
- Identified and reported inconsistencies in product titles, descriptions, and pricing to ensure data quality.
- Utilized the client's proprietary data reviewer tool to manage and track review tasks efficiently.
Freelance Quality Analyst at Telus International (2022-11 – 2023-03)
- Reviewed social media content including images and videos for compliance with platform guidelines using the SRT tool.
- Escalated policy violations and provided structured feedback to improve content moderation quality.
Education
Bachelor of Business Administration in BBA – Technocrats Institute of Commerce and Science (2019-08 – 2022-08)
