Full-Stack Python Developer (Remote)

• Role: Full Stack Software Engineer (Remote)
• Location: Remote (Work from Anywhere)
• Payout: Competitive

Role Overview: We are hiring for one of our clients, seeking a Senior Software Engineer – Go (LLM Evaluation & Repository Validation) to work on a part-time remote basis. This role involves building and evaluating verifiable software engineering tasks derived from public repository histories using synthetic and human-in-loop approaches. The work directly supports the development of high-quality datasets to train large language models for realistic software engineering problems.

Candidates will engage with trending open-source libraries and contribute to a project at the intersection of practical AI and software engineering.

Key Responsibilities:

• Design, implement, and maintain Go-based tools for automated repository analysis, issue triaging, and test coverage evaluation.
• Develop and refine synthetic software engineering (SWE) tasks aligned with real-world code repositories, ensuring dataset quality and task diversity.
• Analyze and triage GitHub issues across high-impact open-source libraries to identify patterns and inform dataset curation priorities.
• Implement and automate development environment setups for consistent task validation and performance testing.
• Collaborate with cross-functional teams to improve LLM evaluation frameworks and incorporate feedback into iterative development cycles.

Required Skills & Qualifications:

• 5+ years of professional software engineering experience with Go, demonstrated through production-grade projects or contributions to open-source systems.
• Deep familiarity with public GitHub repositories, including issue tracking, version control workflows, and code review processes.
• Experience designing and validating software engineering tasks or benchmarks, ideally in AI or machine learning contexts.
• Proficiency in scripting and automation tools (e.g., Bash, Python) to streamline development and evaluation pipelines.
• Strong problem-solving skills with the ability to work independently and iterate on technical solutions in a dynamic environment.

More About the Opportunity:

This role offers the chance to contribute to a cutting-edge initiative at the forefront of AI-assisted software development. Participants will influence how large language models interact with real code, shaping the future of developer tools and automation. The project combines practical software engineering with AI research, providing global exposure to evolving industry standards and collaboration with experts across disciplines.

Equal Opportunity Employer:

We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.

Apply Now!