Nafisa Medha

AI-focused technical builder with 4+ years spanning LLM/RLHF evaluation, applied machine learning research, and solo software product development. Currently evaluate model outputs for safety and instruction-following compliance across two concurrent AI evaluation engagements (SME Careers, RWS Group), while independently designing, building, and shipping AI-integrated mobile products end-to-end. Co-authored a supervised machine learning study on AI overreliance, accepted for ICRPSET 2026.

Operates comfortably at the intersection of model behavior, data, and product.

Quality Assurance Lead at SME Careers (2026-06 – Present)

Contractual

• Serve as Quality Assurance Lead on SME Careers' RLHF 2.5 Safety evaluation program, reviewing LLM outputs and annotator work for safety, policy compliance, and rubric adherence.
• Apply structured quality-assurance methodology to a high-volume LLM annotation pipeline, maintaining consistency across evaluators.

Data Annotator & LLM Evaluator at RWS Group (2025-09 – Present)

Contract

• Audit LLM training data at production scale across text, image, audio, and video modalities, validating annotation accuracy, formatting, and instruction-following compliance.
• Identify systematic labeling errors and data anomalies across concurrent training projects, translating findings into quality-improvement recommendations before they reach model training.
• Author evaluation rubrics and validation rules adopted team-wide, reducing escalations over 8+ months.

Product Support Intern at Oleyn AI (2026-02 – 2026-03)

Internship

• Supported product and customer-facing operations during a 2-month internship focused on AI product support workflows.

Independent Travel Consultant at ASAP Tickets (2024-04 – 2024-08)

Freelance

• Managed client travel planning and itinerary coordination for 100+ accounts using the Customer Management System (CMS).
• Completed structured training in itinerary reading, market research, and flight presentation as part of an independent consultant certification track.

Mobile Application Developer & She Squad Leader at bdapps / Robi (2023-05 – Present)

• Led a cross-functional team of 5 developers, delivering 8+ production features with 99.2% uptime serving 5,000+ daily active users.
• Lead and coordinate a nationwide network of female developers through the She Squad program, mentoring 20+ aspiring developers; ranked 7th nationwide among She Squad Leaders in Bangladesh (2025).

Technical Support Specialist at Vision Cables (2020-05 – 2023-10)

• Led a technical team of 4 on infrastructure projects.
• Managed critical operational data, including customer records and financial information, with zero data loss incidents.
• Built and maintained the documentation and knowledge base still used by clients and internal teams.

B.Sc. in Computer Science & Engineering – Northern University of Business and Technology, Khulna (2026-08)