Ranveer Singh Yadav
AI BENCHMARKING & EVALUATION SPECIALIST
Hire their services
Request a quote with no obligation
About
AI Benchmarking & Evaluation Specialist with experience in AI/LLM output review, structured task creation, evaluation criteria, rubric design, evidence-based research, and technical documentation. Skilled at assessing model responses against instructions and quality standards, identifying failure modes, and producing clear, auditable findings. Also brings a machine-learning engineering background spanning Python, ML evaluation, LLMs, RAG, and AI-agent task benchmarking.
Experience
AI Benchmarking & Research Specialist | Freelance - AfterQuery
- Contributed to AI research and evaluation work involving cross-search tasks that combine local workspace artifacts with open-web evidence.
- Reviewed source materials, located supporting public evidence, and synthesized information into verifiable conclusions with clear citations.
- Created structured benchmark tasks, reference answers, evidence notes, and grading rubrics to assess AI-agent research and reasoning.
- Applied task-quality guidance and evidence-localization practices to make evaluation outcomes traceable and auditable.
Senior Machine Learning Engineer - NovaML AI
(2024-01)
- Designed ML pipelines using PyTorch, TensorFlow, and JAX for model development, evaluation, and AI-agent task workflows.
- Created structured ML coding tasks covering preprocessing, model training, and debugging, with rubrics, edge cases, and grading criteria.
- Worked with transformer-based LLMs, RAG systems, evaluation datasets, and benchmark design.
- Documented agent failure modes and model performance findings for cross-functional teams.
Machine Learning Engineer - VisionMind Labs
(2021-07 - 2023-12)
- Developed computer-vision and NLP models, selecting architectures and evaluating model performance.
- Applied feature engineering, hyperparameter tuning, and model monitoring; analyzed recurring model failures.
AI/LLM Training & Evaluation Specialist | Freelance - TELUS International
(2021 - 2023)
- Reviewed AI/LLM outputs against task instructions, quality criteria, and evaluation guidelines.
- Documented quality issues and provided structured feedback to support consistent model assessment and improvement.
Mathematics Content Developer | Freelance - JustAnswer
(2020 - 2023)
- Developed and reviewed mathematics learning content, verified problem solutions, and checked explanations for accuracy and clarity.
Data Analyst & Reporting Executive | Freelance - Upwork
(2018 - 2020)
- Organized and analyzed datasets, prepared reports, and presented findings in clear, structured formats.
Machine Learning Engineer - DeepScale Technologies
(2019-06 - 2021-06)
- Developed classification, regression, recommendation, and anomaly-detection models using TensorFlow, scikit-learn, and XGBoost.
- Evaluated models using ROC-AUC, F1, precision, and recall, and documented results for stakeholder review.
- Supported cloud-based ML training and deployment workflows on AWS.
Education
Integrated Dual Degree (B.Tech + M.Tech) - Computer Science - Indian Institute of Technology (BHU), Varanasi (2018-08 - 2023-05)

