Software Engineer (Remote | )
Technology
Synthires2 months ago
Service contractFully remote
Job description
Software Engineer
Position: Software Engineer
Type: Contractor
Compensation: $90–$140/hourLocation: Remote
About the Opportunity micro1 is engaging experienced Software Engineers to contribute to a project focused on evaluating advanced AI system outputs. You will apply your software engineering expertise to assess AI-generated technical content and help train next-generation AI systems through high-quality, real-world evaluation.This engagement focuses on critical analysis and content evaluation rather than software development or feature delivery . You will review technical responses such as documentation, error messages, code comments, architectural explanations, and instructions, assessing whether they are accurate, clearly communicated, audience-appropriate, and genuinely useful.
Responsibilities
- Evaluate and compare AI-generated responses to technical prompts for correctness, clarity, tone, and usefulness.
- Assign analytical quality scores and provide detailed written rationales supporting each assessment.
- Identify technically accurate responses that are poorly communicated or insufficiently useful.
- Detect responses that appear fluent but contain factual inaccuracies or misleading information.
- Review technical content for subtle errors, inconsistencies, ambiguities, and omissions.
- Assess whether technical explanations and instructions are appropriate for their intended audience.
- Document observations and evaluation findings with precision and consistency.
- Collaborate asynchronously with project managers and reviewers to maintain alignment on evaluation standards.
- Work independently to complete assigned requirements and deliverables within established timelines.
- Native-level English fluency and exceptional written communication skills.
- Professional experience as a Software Engineer using a modern technology stack.
- Experience authoring or reviewing technical documentation, design documents, API references, or technical specifications.
- Experience conducting code reviews, design reviews, or providing feedback on technical writing.
- Strong ability to evaluate technical communication for accuracy, clarity, audience appropriateness, and instructional value.
- Excellent analytical and critical-thinking skills.
- Meticulous attention to detail when reviewing technical content.
- Strong editing and written communication abilities.
- Ability to work independently and consistently in a remote environment.
- Experience evaluating technical documentation or developer-facing content at scale.
- Strong understanding of software architecture and engineering concepts.
- Experience reviewing API documentation, implementation guidance, or technical instructions.
- Familiarity with AI model evaluation, annotation, or RLHF projects.
- Experience identifying subtle technical inaccuracies in otherwise well-written content.
- Strong ability to distinguish technical correctness from effective communication.
- Experience working asynchronously with distributed technical or review teams.
- $90–$140 per hour
- Contractor engagement
- Fully remote
- Work focused on AI-generated technical content evaluation and analysis
- Candidates should have professional Software Engineering experience with a modern technology stack.
- Strong written English and technical communication skills are essential.
- Prior AI evaluation or annotation experience is not required .
- Submit your application highlighting your Software Engineering experience.
- Detail your experience with technical documentation, code review, design review, or technical writing.
- Demonstrate your ability to critically evaluate technical content for correctness, clarity, and usefulness.
- Selected candidates will be considered for the AI evaluation project based on their technical expertise and communication skills.
- Complete assigned evaluation work independently while following established project standards and deadlines.
Keywords
external-workforceartificial-intelligenceassessment-assessment-toolstesting-and-analysissoftware-developmenttraining-and-developmenterrors-omissions-e-oai-generated-answerstarget-audienceinsurance-consulting-and-technologytechnology-stackauthoringplanning-and-designvisual-art-designproduct-development-and-designconstruction-documentationapplication-programming-interface-apicode-reviewinstructionalenvironment-health-and-safety-hsse
Interested in this role?