Luok Patrick
Looking for a job
Talent
SpringfieldMember since September 23, 2026
Response EvaluationFact-CheckingRelevanceCompletenessHelpfulnessClaim VerificationAnnotation guidelinesArtificial IntelligenceStrong written communicationLLM Evaluator
·
Hire this person
Send a job offer directly to this candidate
Response EvaluationFact-CheckingRelevanceCompletenessHelpfulness
About
Detail-oriented AI training and data annotation professional experienced in evaluating AI-generated content, fact-checking claims, identifying hallucinations, and applying consistent labels to text and safety-sensitive content. Skilled in rubric-based response ranking, editing, classification, ambiguity review, and following detailed guidelines with strong written communication, research, and analytical judgment.
Experience
AI Training, Response Evaluation & Data Annotation (2025 – Present)
- Create challenging, realistic prompts to test an artificial intelligence system's reasoning, instruction-following, factual accuracy, and ability to handle ambiguity.
- Compare multiple AI-generated responses and rank them against explicit quality criteria, including correctness, relevance, completeness, clarity, helpfulness, and adherence to complex instructions.
- Edit, rewrite, and improve model outputs to make responses clearer, more accurate, natural, concise, and aligned with the requested tone and task.
- Review AI outputs for hallucinations, unsupported claims, contradictions, misleading statements, and other factual or logical weaknesses; conduct fact-checking and research-based claim verification where appropriate.
- Apply text labels and classifications consistently according to defined annotation guidelines, maintaining accuracy when handling edge cases and sensitive or ambiguous examples.
- Assess safety-sensitive and policy-related scenarios, including potentially harmful, inappropriate, or disallowed content, and flag material requiring escalation or further review.
- Identify subtle quality issues including missing context, instruction violations, overconfident language, poor refusal behavior, bias indicators, and irrelevant or incomplete answers.
- Maintain consistent evaluation standards across repetitive, high-volume tasks while documenting rationale clearly enough for quality-control review and asking clarifying questions when needed.
Writing, Editing & Content Quality
- Produce and refine written content with emphasis on grammar, structure, clarity, factual coherence, audience fit, and professional tone while following complex instructions.
- Rewrite source material while preserving intended meaning and improving readability, organization, and precision.
- Review written material for inconsistencies, unclear or unsupported claims, missing information, formatting issues, and language-quality problems.
- Adapt content for different audiences and instructions while maintaining accuracy and natural language quality.
Data Entry, Transcription & Language-Quality Tasks
- Transcribe and organize information with strong attention to accuracy, spelling, formatting, and consistency.
- Review text and language data for errors and apply structured corrections or classifications according to task requirements.
- Handle repetitive, detail-sensitive workflows while maintaining quality and meeting defined instructions and deadlines.
Skills
Looking for a job
