Jolly Ugbada

Research and AI Evaluation Specialist with 6+ years of experience across research, data annotation, quality assurance, and analytical work. Skilled in investigating information, verifying factual accuracy, reviewing AI-generated outputs, identifying reasoning and evidence gaps, and documenting errors systematically. Experienced in applying detailed guidelines, resolving ambiguous cases, analysing recurring quality issues, and improving consistency through calibration and clear documentation.

Strong written communication, critical thinking, and evidence-based research skills, with an interest in developing challenging web research benchmarks that evaluate advanced AI systems.

Research & AI Evaluation Specialist - Independent / Contract Projects

(2024 - 2025)

• Evaluate AI-generated responses for factual accuracy, relevance, completeness, clarity, and adherence to task requirements.
• Conduct structured research to investigate claims, compare information across sources, and assess whether responses are supported by reliable evidence.
• Identify unsupported conclusions, factual inconsistencies, missing context, and errors in AI-generated answers.
• Document evaluation findings with clear explanations, evidence, and actionable feedback.
• Analyse recurring model errors and ambiguous cases to identify patterns that affect evaluation quality.
• Apply evaluation guidelines consistently and escalate cases requiring additional interpretation or verification.
• Compare alternative answers against explicit criteria to determine which responses best satisfy the research question.
• Support continuous quality improvement through feedback, calibration, and structured error documentation.

Data Annotation & Quality Assurance Specialist - Contract AI Data Projects

(2022 - 2024)

• Review and annotate text, search results, and other AI-related data according to detailed project guidelines.
• Perform quality checks to identify incorrect labels, inconsistent judgments, missing information, and guideline violations.
• Resolve ambiguous cases by examining context, interpreting task instructions, and documenting the rationale for decisions.
• Identify disagreement patterns and recurring annotation errors, supporting more consistent reviewer decisions.
• Participate in calibration activities to align quality standards and improve evaluation consistency.
• Review completed work for accuracy, completeness, formatting, and compliance with project requirements.
• Maintain clear documentation of edge cases, corrections, and quality issues for future reference.
• Balance productivity with accuracy while meeting project deadlines and changing task requirements.

Research & Data Analyst - Independent Research Projects

(2018 - 2021)

• Gathered and organized information from multiple sources to support analytical research and evidence-based conclusions.
• Examined data for inconsistencies, missing values, and errors before using it in reports or analysis.
• Compared findings across sources to identify patterns, conflicting claims, and information requiring further investigation.
• Structured research findings into clear summaries, tables, and written reports.
• Applied critical thinking to distinguish relevant evidence from information that did not adequately support a conclusion.
• Used spreadsheets to organize research materials, track findings, and support data validation.
• Maintained organized records of research methods, observations, and analytical results.
• Communicated findings in clear, concise language for review and further decision-making.

Bachelor’s Degree - Political Science - University of Calabar, Cross River, Nigeria (2015)