Eric Djholy
AI EVALUATION SPECIALIST | AI RESEARCH | LLM EVALUATION
Hire this person
Send a job offer directly to this candidate
About
Analytical technology professional with experience spanning AI content evaluation, research, data analysis, quality assurance, and information review. Experienced in assessing AI-generated content for accuracy, relevance, completeness, reasoning quality, and compliance with detailed instructions. Recognized for strong attention to detail, independent judgment, research ability, and clear written communication.
Comfortable working asynchronously on complex, project-based assignments and rapidly adapting to new evaluation criteria and subject areas.
Experience
AI CONTENT EVALUATION SPECIALIST at SCALE AI (2024-01 – Present)
- Evaluate AI-generated responses for accuracy, relevance, clarity, completeness, and instruction-following.
- Identify factual errors, unsupported claims, contradictions, and reasoning inconsistencies.
- Compare alternative AI responses using standardized evaluation criteria.
- Develop and refine prompts designed to test specific AI capabilities.
- Produce structured written feedback explaining evaluation decisions.
- Apply detailed project guidelines consistently across independent assignments.
- Adapt quickly to changing evaluation rubrics and project requirements.
RESEARCH & DATA ANALYST at AMAZON (2021-06 – 2023-12)
- Conducted research and analyzed information supporting operational and business decisions.
- Reviewed datasets and reports for accuracy, completeness, and inconsistencies.
- Created concise summaries and documentation from complex information.
- Used analytical and spreadsheet tools to organize, compare, and interpret information.
- Managed independent analytical assignments while meeting project deadlines.
- Collaborated with cross-functional teams in a fast-paced environment.
CONTENT QUALITY ASSOCIATE at MICROSOFT (2019-07 – 2021-05)
- Reviewed digital content against established quality and accuracy standards.
- Identified errors, inconsistencies, and potentially misleading information.
- Conducted research and documented findings systematically.
- Applied standardized guidelines across high-volume review assignments.
- Communicated findings and recommendations to project stakeholders.
- Maintained high standards of accuracy while working independently.
Education
MASTER OF SCIENCE in Information Science; Artificial Intelligence · Data Science · Information Retrieval · Research Methods · Statistical Analysis · Human-Computer Interaction – University of Washington (2018 – 2020)
BACHELOR OF SCIENCE in Computer Science; Artificial Intelligence · Machine Learning · Algorithms & Data Structures · Database Systems · Statistics · Software Engineering – University of California, Irvine (2014 – 2018)
