Skip to main content
Yash Munshi

Yash Munshi

LLM Evaluation Engineer - Freelance (Project Groot)

Pune, PuneMember since December 26, 2025
PostgreSQLSupabaseRedisGitHubGitDockerReact.jsFastAPIOAuth 2.0Node.jsExpress.js
·

About

Evaluated 20+ Large Language Model (LLM) responses within RLHF pipelines, improving response quality, factual consistency, and safety alignment across evaluation workflows. Performed 50+ structured analysis of model responses to identify edge cases, hallucinations, logical inconsistencies, and failure patterns. Collaborated on prompt evaluation and AI quality assurance workflows.

Experience

LLM Evaluation Engineer - Freelance (Project Groot) - Soul AI - Delaware, United States (Remote)

(2026-04)

  • Evaluated 20+ Large Language Model (LLM) responses within RLHF pipelines, improving response quality, factual consistency, and safety alignment across evaluation workflows.
  • Performed 50+ structured analysis of model responses to identify edge cases, hallucinations, logical inconsistencies, and failure patterns.
  • Collaborated on prompt evaluation and AI quality assurance workflows.

Backend Developer Intern - NexCell Solutions - London, United Kingdom (Remote)

(2026-03)

  • Developed 15+ scalable REST API endpoints using FastAPI and PostgreSQL for ConneX AI, enabling real-time workflow automation and backend integration.
  • Built an event-driven automation engine using Celery and Redis for asynchronous trigger-action execution, improving workflow scalability and enabling reliable background task processing.
  • Implemented DAG-based workflow orchestration with conditional execution logic to support extensible multi-node automation pipelines.
  • Configured CI/CD pipelines using GitHub Actions to automate testing and deployment processes.

Education

B. Tech - Electronics and Computer Science Engineering - Kalinga Institute of Industrial Technology (2023-07 - 2027-07)

Reviews

Related