Ian Scott

Highly detail-oriented AI Data Trainer and LLM Evaluator with hands-on experience in data annotation, model response evaluation, prompt review, transcription quality assurance, search relevance rating, content moderation, and multilingual AI review. Skilled at judging AI-generated outputs for factual accuracy, clarity, helpfulness, safety, tone, user intent alignment, and instruction-following. California-based professional with a strong academic foundation in information systems, computer information systems, analytical research, and digital communication.

AI Data Trainer & LLM Evaluator - Outlier AI - Remote

(2022-01)

• Evaluate AI-generated responses for accuracy, helpfulness, clarity, tone, safety, completeness, and instruction-following.
• Compare multiple model outputs and select the stronger response using detailed human-feedback rubrics.
• Review prompts, user intent, task constraints, hallucinations, weak reasoning, vague answers, and policy issues.
• Provide precise feedback that helps improve generative AI quality, reliability, and user alignment.

Lead Data Annotator & AI Quality Reviewer - Remotasks / Scale AI - Remote

(2020-01)

• Annotate and review text, image, audio, and search-related datasets for machine learning and AI training projects.
• Evaluate search queries, user intent, ranking relevance, and result usefulness for AI-powered search systems.
• Perform QA on completed annotations to identify labeling errors, unclear judgments, and guideline inconsistencies.
• Support multilingual review tasks involving English, French, Japanese, and German content.

Senior AI-Assisted Transcription QA Specialist - Verbit.ai - Remote

(2017-08)

• Review and correct AI-generated legal and professional transcripts for accuracy, formatting, grammar, speaker identification, and contextual clarity.
• Use human quality control to improve machine-generated speech-to-text output across sensitive legal, medical, and professional recordings.
• Research legal, medical, and technical terminology to ensure final outputs are accurate and professionally usable.
• Identify recurring transcription model errors, unclear audio issues, and formatting problems that affect final data quality.

Medical Market Research Transcription Specialist - Cadence Translate - Remote

(2019-03)

• Transcribe healthcare interviews, expert consultations, clinical research discussions, and medical market research recordings.
• Verify drug names, procedures, conditions, medical terminology, and healthcare references through careful research.
• Handle confidential healthcare-related content with professional care and privacy awareness.

Legal & Medical Data Quality Specialist - Veritext Legal Solutions - Remote

(2017-03 - 2025-10)

• Prepared and reviewed high-accuracy legal transcripts for litigation, depositions, hearings, civil matters, and government-related proceedings.
• Verified complex legal, medical, and technical terminology through independent research and contextual review.
• Applied strict formatting, confidentiality, and quality standards across sensitive documentation.

Transcription & Documentation QA Specialist - Esquire Deposition Solutions - Remote

(2020-01 - 2024-12)

• Managed complex deposition transcription projects involving legal, medical, technical, and expert witness testimony.
• Edited transcripts for grammar, punctuation, legal formatting, timestamps, speaker labels, and client-specific style requirements.
• Reviewed unclear audio, overlapping speech, and specialized terminology with strong attention to detail.

Master of Science - Information Systems - University of Southern California (2017-01 - 2019-01)

Bachelor of Science - Computer Information Systems - California State University, Los Angeles (2013-01 - 2017-01)

High School Diploma - Fairfax High School (2013-01)