Abhushan Chataut
LLM Quality Assurance
Hire this person
Send a job offer directly to this candidate
About
Evaluated and rated Large Language model outputs for factual accuracy, reasoning quality and safety compliance maintaining 95% inter-rater reliability score. Performed data annotation, categorization and validation on 1,000+ text samples weekly, directly contributing to the training of next generational models. Applied analytical and domain expertise in finance and technology to assess complex, specialized prompts, flag edge cases, and provide detailed written justifications for quality control.
Experience
LLM Quality Assurance - Welo Data - Remote
(2024-01)
- Evaluated and rated Large Language model outputs for factual accuracy, reasoning quality and safety compliance maintaining 95% inter-rater reliability score.
- Performed data annotation, categorization and validation on 1,000+ text samples weekly, directly contributing to the training of next generational models.
- Applied analytical and domain expertise in finance and technology to assess complex, specialized prompts, flag edge cases, and provide detailed written justifications for quality control.
- Utilized proprietary evaluation platforms and spreadsheets to track performance metrics, consistently meeting daily throughput and quality targets.
Surveillance Monitor - Secured Defence Corp - Vancouver
(2026-04)
- Monitored 9–12 concurrent displays across 3 integrated security platforms, rapidly analyzing and triaging 1,000+ hourly alerts to accurately separate false positives from critical security events.
- Executed rapid response and escalation protocols during active threats, coordinating emergency broadcasts and direct communication with law enforcement and authorities.
- Captured, formatted, and structured high-frequency operational data into image formats (bmp & jpg) to build clean training datasets, directly supporting the continuous improvement of computer vision and AI detection models.
- Performed frontline technical troubleshooting for server disruptions and network inefficiencies, executing rapid system recoveries and technical escalations to ensure zero-downtime surveillance continuity.
Customer Services Associate - First Services Residential - Vancouver
(2025-03 - 2026-04)
- Compiled compliance evidence into centralized databases to support security claims, incident documentation, and regulatory audit requirements.
- Performed troubleshooting, resolution, patching, and access control system management for digital entry systems, coordinating with IT support to apply security updates and maintain system integrity.
- Administered internal ticketing systems for tenant requests and security incidents, driving timely resolution, logging accurate records, and routing complex issues to appropriate teams for escalation.
Member of a Technical Team - TGS - Kathmandu (Remote)
(2023-06 - 2024-12)
- Resolved IT infrastructure issues including server outages, network failures, and desktop hardware/software problems for 50+ users, reducing overall system downtimes by 30%.
- Gathered requirements and designed dashboard interfaces that improved data visualization bridged decision-making efficiency for management teams.
- Gathered, cleaned, and stored critical vendor information into the proprietary database, enabling targeted digital strategies that significantly improved customer engagement and retention.
- Coordinated the full software lifecycle updates, license renewals, and new implementations maintaining strict compliance and delivering 5+ timely updates per month with zero budget overruns.
Undergraduate Research Assistant - Asia Pacific University, LBEF Campus
(2016-08 - 2020-02)
Professor: JyotirMoy Chatterjee
- Early Risk of depression detection using RNN on Textual Datasets (NLP)
- Book Chapter on Machine Learning for Healthcare
Internship - ICT Solutions Nepal - Kathmandu
(2018-09 - 2018-12)
- Contributed to AI development by investigating RNN models for textual processing on a 1 million+ textual data corpus for proprietary clinical decision support systems, ensuring strict compliance with HIPAA
Education
Master of Science - Information Technology - Westcliff University (2022-01 - 2024-01)
Bachelors - Information Technology - Asia Pacific University (2016-01 - 2020-01)