Skip to main content
Ranveer Singh Yadav

Ranveer Singh Yadav

AI BENCHMARKING & EVALUATION SPECIALIST

US40 USD/hourMember since October 14, 2026
rubric designreference answerstechnical documentationPythonFastAPIPyTorchTensorFlowJAXscikit-learnXGBoostTransformersLLMsRAGLangChainAWSMLflowvector databases
·

Hire their services

Request a quote with no obligation

About

AI Benchmarking & Evaluation Specialist with experience in AI/LLM output review, structured task creation, evaluation criteria, rubric design, evidence-based research, and technical documentation. Skilled at assessing model responses against instructions and quality standards, identifying failure modes, and producing clear, auditable findings. Also brings a machine-learning engineering background spanning Python, ML evaluation, LLMs, RAG, and AI-agent task benchmarking.

Experience

AI Benchmarking & Research Specialist | Freelance - AfterQuery

  • Contributed to AI research and evaluation work involving cross-search tasks that combine local workspace artifacts with open-web evidence.
  • Reviewed source materials, located supporting public evidence, and synthesized information into verifiable conclusions with clear citations.
  • Created structured benchmark tasks, reference answers, evidence notes, and grading rubrics to assess AI-agent research and reasoning.
  • Applied task-quality guidance and evidence-localization practices to make evaluation outcomes traceable and auditable.

Senior Machine Learning Engineer - NovaML AI

(2024-01)

  • Designed ML pipelines using PyTorch, TensorFlow, and JAX for model development, evaluation, and AI-agent task workflows.
  • Created structured ML coding tasks covering preprocessing, model training, and debugging, with rubrics, edge cases, and grading criteria.
  • Worked with transformer-based LLMs, RAG systems, evaluation datasets, and benchmark design.
  • Documented agent failure modes and model performance findings for cross-functional teams.

Machine Learning Engineer - VisionMind Labs

(2021-07 - 2023-12)

  • Developed computer-vision and NLP models, selecting architectures and evaluating model performance.
  • Applied feature engineering, hyperparameter tuning, and model monitoring; analyzed recurring model failures.

AI/LLM Training & Evaluation Specialist | Freelance - TELUS International

(2021 - 2023)

  • Reviewed AI/LLM outputs against task instructions, quality criteria, and evaluation guidelines.
  • Documented quality issues and provided structured feedback to support consistent model assessment and improvement.

Mathematics Content Developer | Freelance - JustAnswer

(2020 - 2023)

  • Developed and reviewed mathematics learning content, verified problem solutions, and checked explanations for accuracy and clarity.

Data Analyst & Reporting Executive | Freelance - Upwork

(2018 - 2020)

  • Organized and analyzed datasets, prepared reports, and presented findings in clear, structured formats.

Machine Learning Engineer - DeepScale Technologies

(2019-06 - 2021-06)

  • Developed classification, regression, recommendation, and anomaly-detection models using TensorFlow, scikit-learn, and XGBoost.
  • Evaluated models using ROC-AUC, F1, precision, and recall, and documented results for stakeholder review.
  • Supported cloud-based ML training and deployment workflows on AWS.

Education

Integrated Dual Degree (B.Tech + M.Tech) - Computer Science - Indian Institute of Technology (BHU), Varanasi (2018-08 - 2023-05)

Skills

AI BENCHMARKING & EVALUATION SPECIALIST

Reviews

Related