Besnik Demiri

AI Data Quality and Operations Specialist with 3+ years of experience supporting generative AI model improvement through prompt evaluation, response analysis, and structured data annotation. Proven ability to maintain high-accuracy datasets, identify response quality issues, and provide actionable feedback that improves AI model alignment and performance.

Background in business operations and administrative systems with strong attention to detail, workflow organization, and cross-team coordination. Skilled at analyzing AI outputs, enforcing quality standards, and ensuring data integrity across large-scale evaluation projects.

AI Data Quality Analyst at Outlier AI, Remotasks (2023-01 – Present)

Evaluate generative AI outputs to ensure accuracy, consistency, and alignment with project guidelines, contributing to improved training data quality for large language models.

• Review and rate AI-generated prompts and responses to assess accuracy, clarity, and alignment with quality standards.
• Conduct detailed analysis of AI responses to identify errors, inconsistencies, or policy violations.
• Provide structured feedback to support refinement of AI training datasets and model outputs.
• Maintain strict data quality standards while processing high volumes of evaluation tasks.
• Research and validate information to ensure accurate labeling and model training guidance.
• Collaborate with project guidelines and evaluation frameworks to support consistent AI model training.

Administrator at Nick's Auto Service (2023-01 – 2023-08)

Managed administrative operations and customer service coordination in a high-volume automotive service environment.

• Coordinated front desk operations, including appointment scheduling and service workflow management.
• Processed transactions for automotive parts and services while maintaining accurate financial documentation.
• Maintained detailed records of customer interactions and service activity.
• Facilitated communication between customers, service staff, and management to ensure operational efficiency.
• Supported daily operational workflows to maintain service quality and customer satisfaction.

Administrative Assistant at Delta Air Lines (2014-08 – 2020-10)

Provided administrative and operational support in a fast-paced airline environment, ensuring efficient customer service and accurate documentation.

• Managed reception and check-in support functions, assisting passengers and coordinating service requests.
• Processed documentation, billing information, and itinerary updates within internal systems.
• Maintained detailed meeting notes and operational records within CRM and documentation systems.
• Supported management staff with scheduling, reporting, and administrative coordination.
• Delivered professional customer interaction while maintaining operational accuracy.

Bachelor of Science in Business Administration – Central Penn College