Naufal Zaky

AI Data Annotator and Linguistic Quality Specialist with 3 years of hands-on experience evaluating and refining Large Language Model (LLM) outputs.

Background in English Education with a focus on Linguistics and Translation, paired with practical experience in prompt engineering and AI-assisted workflows. Experienced in designing annotation rubrics and maintaining data quality across academic, literary, and localization projects, working between English and Indonesian with close attention to linguistic nuance. Good at analytical and critical thinking.

AI Data Annotator & LLM Evaluator at Freelance / Contract Projects (2023-01 – Present)

• Annotated and evaluated LLM outputs using rubric-based scoring, including labeling, reviewing, and validating AI-generated language data for accuracy and quality.
• Designed annotation rubrics to assess linguistic quality, coherence, contextual relevance, and factual accuracy in model responses.
• Applied RLHF (Reinforcement Learning from Human Feedback) principles to evaluate and rank AI responses, providing structured feedback on conversational quality.
• Followed annotation guidelines closely to keep evaluations consistent with other annotators, raising ambiguous cases with team leads when guidelines were unclear.
• Flagged edge cases, ambiguous prompts, and recurring model failure patterns in structured reports for the review team.

Prompt Engineer & AI Integration Specialist at Freelance / Personal Projects (2022-01 – 2024-12)

• Designed and refined prompts for code generation, content creation, and task automation across a range of personal and freelance projects.
• Experimented extensively with AI-assisted development workflows, building practical judgment on what makes a prompt effective versus what doesn't.
• Built small AI-powered workflows that integrated LLMs into everyday productivity tasks.

Translator & Localization Specialist at Freelance (2022-01 – 2024-12)

• Translated 1,000+ pages of literary content across multiple books, delivering contextually accurate and linguistically precise Indonesian–English translations.
• Translated 50+ research articles and diverse academic/non-academic materials, maintaining domain-specific terminology and formal register throughout.
• Performed game localization testing for web-based applications, ensuring cultural appropriateness, UX consistency, and linguistic accuracy across in-game text and UI elements.

QA Tester & Bug Reporter at Web Application Projects (2020-01 – 2022-12)

• Conducted comprehensive pre-launch quality assurance testing on multiple web applications, identifying and documenting critical defects to ensure optimal functionality and user experience.
• Applied systematic debugging methodologies to diagnose, troubleshoot, and resolve complex technical issues, producing clear and actionable bug reports for development teams.

Bachelor of English Education in Linguistics, Translation, and English as a Foreign Language (EFL) – Universitas Islam Negeri (UIN) Syekh Wasil Kediri (2022-08 – 2026-06)