Skip to main content
Yemi Olugbemi

Yemi Olugbemi

LLM Annotator

Talent
LagosMember since November 11, 2026
AI Response Evaluation and RatingPrompt Interpretation and Instruction FollowingHuman Judgment and Reasoning ValidationBias Detection and Ethical AI ReviewContent Moderation and Policy AdherenceData Quality AssuranceLanguage and Intent Analysis (English and Yoruba)Critical Thinking and Decision Consistency
·

Hire this person

Send a job offer directly to this candidate

AI Response Evaluation and RatingPrompt Interpretation and Instruction FollowingHuman Judgment and Reasoning ValidationBias Detection and Ethical AI ReviewContent Moderation and Policy Adherence

About

AI Generalist and Human-in-the-Loop Specialist with 5+ years of experience supporting AI systems through data evaluation, content review, prompt interpretation, and quality assurance. Experienced in AI response evaluation, bias detection, guideline-based judgment, reasoning validation, and quality improvement workflows. Strong analytical thinking, attention to detail, and communication skills, with the ability to follow complex instructions and apply consistent judgment.

Yoruba speaker with advanced English proficiency (C1).

Experience

AI Video Annotator (Video Captioning and Motion Capture) at Sovorano AI (2026-08 – Present)

  • Annotated egocentric and 3D motion-capture video clips for AI model training, producing high-level summaries and segment-level captions.
  • Applied a 19-rule captioning framework covering tense, direction, posture, segmentation boundaries, and content adequacy.
  • Segmented clips at action boundaries, ensuring full coverage without gaps or overlaps.
  • Corrected machine-generated labels for hand actions, object interactions, and hand continuity across frames.
  • Identified and resolved quality issues including missed actions, inconsistent object naming, prohibited verbs, and hallucinated content.
  • Distinguished valid task footage from staged or unusable clips using reject and skip criteria.
  • Maintained accuracy scores above target thresholds while meeting productivity benchmarks.

AI Data Specialist (Generalist Focus) at Defined.ai (2021-07 – 2025)

  • Evaluated AI-generated outputs for accuracy, relevance, tone, and instruction compliance.
  • Applied detailed guidelines to assess language understanding, intent classification, and response quality.
  • Reviewed and corrected annotated datasets to improve consistency and fairness.
  • Flagged bias, ambiguity, and ethical risks in AI responses.
  • Provided structured feedback to support improvements in AI system behavior.
  • Collaborated with distributed teams on quality calibration exercises.

AI Rater / Content Evaluator at TELUS International AI (2019-01 – 2021-06)

  • Rated search results, text outputs, and AI responses based on relevance and usefulness.
  • Performed user-intent classification and language-understanding tasks.
  • Assessed AI-generated content against predefined quality standards.
  • Maintained high accuracy while meeting productivity targets.

AI Language and Content Evaluator (Freelance) at Appen (2018-03 – 2018-12)

  • Evaluated conversational AI responses for coherence, tone, and correctness.
  • Reviewed text classification outputs and alignment tasks.
  • Followed data privacy and ethical guidelines.

Education

Bachelor of Science (B.Sc.) in Information Systems – Les Cours Sonou University (2018 – 2022)

Postgraduate Certification in Artificial Intelligence and Big Data – Les Cours Sonou University (2021 – 2022)

Skills

LLM Annotator

Reviews