Skip to main content
Viren Bochare

Viren Bochare

AI / LLM Quality Engineer

Talent
TorontoMember since May 7, 2026
automation testingPromptfooAI-Driven Test Automation & Self-Healing FrameworksLLMOps (Metrics such as Hallucination, Drift detection, fairness)MLOps (Metrics such as Precision, Accuracy, F1 Score, Recall)Test Architecture (UI, API, Microservices, Event-driven systems)Playwrightcypressc#pythonPandasDatadogObservabilityPactContract TestingAWSAzure DevOpsSQL
·

Hire this person

Send a job offer directly to this candidate

automation testingPromptfooAI-Driven Test Automation & Self-Healing FrameworksLLMOps (Metrics such as Hallucination, Drift detection, fairness)MLOps (Metrics such as Precision, Accuracy, F1 Score, Recall)

About

Principal QA Engineer with 15+ years of experience architecting enterprise-scale quality engineering platforms for SaaS and fintech systems. Specialized in LLM & AI Quality Engineering, with hands-on experience validating non-deterministic AI systems through prompt engineering, hallucination detection, output consistency validation, and model performance evaluation using Promptfoo, LangChain, and the OpenAI API.

Expert in building self-healing automation frameworks, cloud-native test infrastructure, and CI/CD-integrated quality pipelines using Playwright, TypeScript, Python, and AWS. Proven leader in defining next-generation QA strategies, embedding continuous LLM evaluation into MLOps and LLMOps workflows, and influencing quality practices across engineering, data science, and product teams.-

Experience

Principal Software Development Engineer in Test Dec 2021 – Present

AutoTrader, Toronto, ON

  • Defined and own enterprise-wide quality engineering strategy across 6 product teams, establishing standards for automation, testing practices, and quality gates
  • Drive cultural shift from manual testing to AI-native quality engineering, increasing automation coverage from 30% to 85% while reducing manual testing effort by 60%
  • Architect a Playwright + TypeScript automation platform integrated with AI-assisted test generation (via MCP + GitHub agents), enabling automated test generation from requirements and accelerating shift-left testing
  • Design and implement self-healing automation strategies that automatically adapt to UI changes, improving test stability from 65% to 94% and reducing flaky test maintenance by 80%
  • Build cloud-native test infrastructure (AWS EC2 + Docker) enabling scalable execution across multiple environments and parallel test pipelines
  • Introduced intelligent CI/CD pipelines executing tests on every PR with optimized test selection and faster feedback loops
  • Develop test observability ecosystem using Datadog, enabling real-time insights into failures, anomalies, flaky tests, and performance trends
  • Define enterprise QA architecture and governance, standardizing tools, frameworks, and quality practices across teams
  • Lead adoption of AI-driven quality practices, exploring anomaly detection, automated failure analysis, and predictive quality signals
  • Influenced cross-functional teams across engineering, product, and operations to drive quality improvements, streamline delivery processes, and implement strategic changes without direct authority
  • Own quality feedback loop through A/B testing, customer feedback analysis, and bug triage, surfacing failures earlier in the SDLC
  • Mentor teams and perform code reviews for automation and application code, ensuring scalable and maintainable automation frameworks
  • Integrated Slack bot notifications to enhance developer feedback loops and system visibility
  • AI & Quality Innovation
  • Implemented AI-assisted test generation reducing manual scripting effort
  • Explored self-healing automation techniques to improve test resilience
  • Built observability-driven quality dashboards for proactive issue detection
  • Enabled shift-left testing practices across CI/CD pipelines
  • Key Quality Achievements
  • Reduced test execution time by 75% (from 2 hours to 30 minutes) via parallelization
  • Increased release confidence through automated CI/CD quality gates
  • Improved defect detection earlier in the SDLC through AI-assisted testing

Senior Software Development Engineer in Test Dec 2020 – Dec 2021

AutoTrader, Toronto, ON

  • Designed scalable UI + API automation frameworks supporting high-traffic marketplace systems
  • Led evaluation and adoption of modern tools (Playwright, Cypress) aligned with long-term architecture
  • Contributed to test strategy for microservices and distributed systems

Software Quality Developer Aug 2020 – Dec 2020

Rocket Innovation Studio, Remote, ON

  • Implemented automated UI and REST API test suites using Postman, Cypress, C#, and JavaScript for fintech platforms with high reliability and security requirements.
  • Partnered closely with engineering teams to embed automation into CI pipelines, improving early defect detection and release confidence.

Software Developer in Test May 2019 – Aug 2020

Firmex, Toronto, ON

  • Developed and maintained UI, smoke, and regression automation using Nightwatch.js and BlazeMeter for a large-scale Virtual Data Room platform.
  • Designed and executed REST API automation using Ruby, RSpec, and Postman to validate backend services and integrations.
  • Supported CI/CD workflows using Jenkins, JFrog, Artifactory, GitHub, Bitbucket, and Git, ensuring reliable builds and automated test execution.

Software QA Engineer Apr 2016 – May 2019

Adlib Software, Burlington, ON

  • Mentored and led QA engineers in adopting automation best practices and built scalable automation frameworks integrated with proprietary in-house tools.
  • Developed and maintained end-to-end, regression, smoke, and web services tests using Selenium, C#, Postman, SoapUI, and SQL.
  • Collaborated cross-functionally with Product Owners, Business Analysts, and stakeholders to ensure quality alignment throughout the SDLC.

Software Engineer Jun 2011 – Jun 2015

Allscripts, India

  • Mentored automation QA teams and established testing standards, frameworks, and documentation for enterprise healthcare applications.
  • Developed and maintained UI automation solutions using C#, Coded UI, and PowerShell for HIPAA- compliant systems, ensuring regulatory adherence and reliability.

Software Test Engineer Jun 2010 – Jan 2011

Enzen Global, Cardiff, UK

  • Performed data migration validation and end-to-end system testing for mission-critical SCADA Applications.
  • Authored detailed test plans and execution strategies, working directly with clients to ensure quality delivery and system readiness.

Education

  • Master of Science in Computer Systems Engineering Sep 2007 – Feb 2009

University of East London, UK

  • Bachelor of Engineering in Computer Science & - Engineering Jun 2001 – Jul 2005

Dr. Babasaheb Ambedkar Marathwada University

Skills

AI / LLM Quality Engineer

Reviews