MCP & Tools Python Developer - Agent Evaluation Infrastructure

Please submit your CV in English and indicate your level of English proficiency.

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.

What This Opportunity Involves

While each project involves unique tasks, contributors may:

Develop and maintain MCP-compatible evaluation servers

Implement logic to check agent actions against scenario definitions

Create or extend tools that writers and QAs use to test agents

Work closely with infrastructure engineers to ensure compatibility

Occasionally help with test writing or debug sessions when needed

Apply professional judgment to assess AI responses

What We Look For

This opportunity is a good fit for python engineers for a new project focused on developing Model Context Protocol (MCP) servers, open to part-time, non-permanent projects

Ideally, contributors will have:

Degree in Computer Science, Software Engineering or related fields

4+ years of Python development experience, ideally in backend or tools

Solid experience building APIs, testing frameworks, or protocol-based interfaces

Understanding of Docker, Linux CLI, and HTTP-based communication

Familiarity with how LLM agents are prompted, executed, and evaluated

Clear documentation and communication skills - you'll work with QA and writers

English proficiency - B2

How It Works

Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid

Effort estimate

Tasks for this project are estimated to take 6-10 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.

Payment

Paid contributions, with rates up to $80/hour

Fixed project rate or individual rates, depending on the project

Some projects include incentive payments

Note:

Rates vary based on expertise, skills assessment, location, project needs, and other factors. Higher rates may be offered to highly specialized experts. Lower rates may apply during onboarding or non-core project phases. Payment details are shared per project