Vidya Vilas

AI and ML Data Professional with 4+ years of experience specializing in multimodal evaluation and prompt refinement. Proven record in enhancing conversational AI model safety, accuracy and output precision across text, audio and visual datasets. Adept at driving data quality standards, root cause analysis and dataset optimization for LLM deployments.

Analyst-AI/LLM Practice at Innodata Pvt Ltd (2025-12 – 2026-10)

• Supported the training and evaluation of Large Language Models (LLMs) through high-quality data annotation and analysis.
• Created and refined prompts to improve model accuracy, response quality, and instruction adherence.
• Evaluated AI-generated outputs using defined quality, relevance, and performance metrics.
• Performed classification, identification labeling, and preference ranking to enhance model learning and behavior.
• Conducted content quality, relevance, and similarity evaluations in accordance with project guidelines.
• Executed response rewriting and summarization tasks to ensure clarity, consistency, and compliance.
• Participated in grading and validation activities to verify feature functionality and model performance.
• Maintained strict data quality and confidentiality standards across AI training workflows.

ML Data Associate at AGI-DS Amazon (2023-08 – 2025-07)

• Collaborated with cross-functional teams to refine language models, enhance customer satisfaction, and contribute to the continuous development of AI conversational systems.
• Identifying the problem by deep dive and conduct root cause analysis to implement corrective solutions.
• Initiated high level of training to expand team's strength and formulated various methodologies for quality improvement.
• Identified issues, analyzed information and provided solutions to problems.
• Specializing in data extraction and preprocessing to enable machine learning workflows.
• Consistently delivered exceptional results, earning recognition for maintaining the highest quality standards.

Digital Associate at Amazon Web Service (2021-09 – 2023-08)

• Performed annotation tasks across various ML data types including audio, image, and video, using internal tools and software.
• Applied strong language and grammar knowledge to validate generated text, ensuring correctness in grammar, syntax, and context.
• Taking ownership in process improvement and settle issues when it comes to tooling and operations.
• Deep diving into all activities and operations which is involved within the team. Involving in the pilot programs to ensure the staging of the process and tooling is performed skillfully.
• Logged and escalated annotation-related queries to relevant stakeholders for resolution, aiding process improvements.
• Raising all failures/doubts related to the execution in the portal and closing the same as per the SLAs.

Bachelor of Technology (B.Tech) in Civil Engineering – Kerala Technological University, College Of Engineering Trikaripur, Kerala

Intermediate (Class XII) – CBSE, SN Vidya Mandir Kannur, Kerala

Intermediate (Class X) – CBSE, SN Vidya Mandir Kannur, Kerala