Devendra Patil
QA / Test Engineer · AI Model Evaluation · Python · SQL · API Testing · Chrome Extension Author
Hire this person
Send a job offer directly to this candidate
About
QA and Test Engineer with 3 years of end-to-end quality ownership across AI model evaluation, payment systems, and fullstack applications. Built and published QA Snapshot Tester (Chrome Web Store) - a DOM regression testing tool used by QA and PMs to catch UI regressions before deployment. Experienced in designing unambiguous test cases, probing edge cases, detecting grading gaps in AI outputs, and debugging Python and full-stack environments.
Proven ability to validate complex business logic across multiple independent paths, identify shortcut-taking behaviours in AI agents, and collaborate in tight feedback loops with researchers and developers.
Postgraduate
Program in Data Science & Engineering. Seeks to apply QA discipline to frontier AI benchmark evaluation.
Experience
QA / Test Engineer - AI & Product - CHRP Technology - Remote
(2023-11)
US-based AI Startup
- Performed primary testing of AI models using Postman before production deployment - validating model responses, grading logic, edge case behaviour, and output consistency across all releases.
- Tested all AI models in production in direct collaboration with the AI engineering team; identified grading gaps, shortcut-taking behaviours, and output ambiguity before they affected benchmark integrity.
- Owned end-to-end quality review of the home inspection AI pipeline: from homeowner-facing inspection link through multi-step AI processing, intermediate report generation, and model inference stages to final client PDF output.
- Validated complex business logic across 10 distinct date-calculation and closing inspection scenarios, each with independent logic paths - designing test cases to cover all permutations and edge-case failures.
- Used prompt engineering and the ChatGPT API to stress-test model behaviour, simulate adversarial inputs, and probe blind spots - reducing manual QA effort by ~30%.
- Designed comprehensive test scenarios and test cases from business requirements, user stories, and acceptance criteria, including positive, negative, and edge-case coverage for AI-driven features.
- Authored the company's definitive QA and operations manual adopted across QA, sales, and operations; recognised by the CEO as the official onboarding and client pitch reference.
- Built and maintained Tableau dashboards tracking QA metrics, defect trends, and process health for leadership-level monitoring.
- Designed a browser extension for reviewing the images on the company's core working portal, which increased team productivity by 40%.
- Actively participated in Agile Scrum ceremonies: sprint planning, backlog grooming, daily stand-ups, story refinement, and release validation.
- Supported release validation cycles: verified data changes, communicated updates to cross-functional teams, confirmed post-release stability.
Education
Post Graduate Program in Data Science & Engineering (PGP-DSE) - Data Science & Engineering - Great Learning (2024-05)
Bachelor of Engineering - Engineering - NMU (2023-06)
