Software LLM Annotator

Job Title: Software LLM Annotator

• Location: Remote
• Engagement Type: Contract
• Duration: 5 Weeks
• Open Positions: 50
• Work Hours: 8 hours/day (4 hours PST overlap mandatory)
• Note: Candidates must have their own working machine (no system will be provided)

About the Role

• Work on evaluating and improving outputs generated by Large Language Models (LLMs)
• Involves a mix of technical understanding, analysis, and structured annotation
• Requires ability to work with AI systems, workflows, and developer tools

Required Qualifications

• 1–3 years of experience in software development, technical support, or similar technical roles
• Strong familiarity with Linux environments and command-line operations
• Proficiency in Python or Bash scripting
• Ability to break down complex problems into structured, step-by-step workflows
• Strong attention to detail in documenting technical processes
• Exposure to LLM-based tools, AI systems, or agentic workflows
• Basic understanding of APIs, file systems, and developer tools
• Familiarity with OpenClaw or similar tools

Nice to Have

• Experience in data annotation, RLHF, or SFT workflows
• Exposure to CI/CD pipelines, REST APIs, and terminal-based automation
• Experience with browser automation or developer productivity tools
• Background in evaluating or improving AI-generated outputs

<