Software Engineer – AI Testing Analyst

About The Role We're seeking experienced software engineers in Toronto to evaluate and improve the performance of frontier AI models. You'll critically assess AI-generated code, identify subtle bugs and hallucinations, and provide expert-level feedback.

Organization: Alignerr

Type: Hourly Contract

Compensation: $50–$100 /hour

Location: Remote

Commitment: 10–40 hours/week What You'll Do Evaluate the performance of frontier language models on complex software engineering tasks

Identify bugs, logical errors, hallucinations, and reliability issues in model outputs

Design and review prompts, test cases, and evaluation scenarios for advanced coding workflows

Provide precise written feedback explaining model strengths, weaknesses, and edge cases

Work across multiple languages and codebases to assess generalization and correctness Who You Are 3–4+ years of professional software engineering experience

Strong proficiency in at least one of: TypeScript, Ruby, Java, or C++

Excellent written and spoken English

Demonstrated ability to reason about complex systems and debug non-obvious issues

Familiarity with modern AI / LLM tooling (Git, CLI workflows, testing frameworks, etc.)

Ability to critically evaluate model behavior rather than simply use model outputs Why Join Us Competitive pay and flexible remote work

Work on cutting-edge AI projects with top research labs

Freelance perks: autonomy, flexibility, and global collaboration

Potential for ongoing work and contract extension Application Process (Takes 10–15 min) Submit your resume

Complete a short screening

Project matching and onboarding PS: Our team reviews applications daily. Please complete your application steps to be considered for this opportunity.