John Oracho

Analytical and detail-oriented professional with extensive experience in AI data annotation, logical evaluation, and team leadership. Skilled in assessing data quality, identifying inconsistencies, and refining task frameworks to improve model performance. Proven ability to analyze complex systems, validate outcomes, and ensure process accuracy through structured reasoning.

Motivated by intellectually challenging work in AI quality assurance, policy logic validation, and agent testing, and passionate about contributing to the ethical advancement of generative AI systems.

Data Annotator (2D, 3D, and LLM Projects) at OneForma (2020-01 – Present)

• Evaluated and annotated complex datasets across visual and textual modalities.
• Reviewed AI model outputs for logic, consistency, and completeness.
• Identified ambiguous task setups and provided feedback to improve evaluation frameworks.
• Collaborated with QA and AI development teams to refine model training data.

LLM and Chatbot Evaluator / Data Annotator at Remotasks (2017-01 – 2022-12)

• Conducted LLM response evaluations for accuracy and reasoning.
• Designed and tested logical task structures and policy evaluation scenarios.
• Validated model outputs ensuring high-fidelity datasets.
• Documented findings and suggested refinements to evaluation workflows.

Team Lead / Associate at Sama Ltd, Kenya (2016-01 – 2022-12)

• Supervised and trained annotation teams, improving precision and consistency.
• Performed quality assessments and identified performance gaps.
• Provided structured feedback and reports to enhance data integrity.
• Promoted logical reasoning and problem-solving during evaluations.

Virtual Assistant / Researcher / Graphic Designer at Upwork & Fiverr (2017-01 – Present)

• Supported clients with research, structured analysis, and documentation.
• Applied logical and creative judgment in analytical projects.
• Managed remote tasks efficiently in asynchronous environments.

Certificate in Virtual Assistant – ALX (2024-02 – 2024-05)

Certificate in Freelance Admin Support – Generation Kenya (2024-04 – 2024-04)

Certificate in Virtual Assistant – Allison Course (2021-11 – 2022-02)

Training in Web Research & Basic Computer Training – Sama School (2015-05 – 2015-08)

Training in Security Management – Youth Empowerment Institute (2014-03 – 2014-09)

KCSE – Makongeni Secondary School (2009-01 – 2012-12)