Nancy Bhardwaj

AI Quality Engineering Lead and Test Automation Architect with 14+ years of experience building enterprise test automation, API quality pipelines, and AI-powered QA solutions. Led distributed teams of up to 15 engineers and architected Playwright (TypeScript) frameworks that reduced regression execution time by 70%. Hands-on experience in Salesforce Agentforce testing, LLM and RAG evaluation, AI-agent behavior validation, AI red teaming and human-in-the-loop review design.

Built practical AI QA platforms and agentic workflows using Python, FastAPI, n8n, LangFlow, MCP, vector databases, RAGAS, Promptfoo, and DeepEval.

Team Lead - QualityAI (Qualitest) - Noida

(2021-08)

Led projects adhering to Agile methodologies, actively participating in Daily Stand-ups, Grooming, Planning, Retrospective, and Demo meetings. Led distributed QA teams of up to 15 engineers, enhancing team productivity and performance. Successfully led and managed distributed teams across multiple time zones, ensuring seamless communication, collaboration, and project delivery.

• Designed and executed utterance-based test suites in Salesforce Agentforce Testing Center, authoring positive and negative utterances per topic to validate intent classification, action-sequence execution, and response accuracy using CSV-based batch testing and Topic/Action/Response pass-rate analysis to catch misrouting before production.
• Led the initiative to set up Newman reporting for enhanced visibility and analysis of API testing results.
• Led the initiative to set up CI/CD pipelines in Azure DevOps, integrating Newman to automate API test execution and reporting.
• Automated Email/Teams notifications for Azure DevOps pipeline events using Power Automate, eliminating manual project coordination.
• Architecting an automation framework using Playwright with TypeScript, following Page Object Model (POM) and CI/CD integration using Jenkins for automated, parallel Playwright test execution.
• Proficient in using Git for source version control.
• Utilized Postman to validate API responses, ensuring accurate and reliable data exchanges.
• Implemented Salesforce solutions in both Sales (CRM & CPQ) and Service Cloud environments.

Sr. Quality Analyst - Classic Informatics - Chandigarh

(2018-03 - 2021-08)

• REST API testing using Postman and Newman, ensuring robust and reliable API functionality.
• Built mock servers in Postman to simulate API interactions for comprehensive testing.
• Managed version control using Git/GitHub, continuous integration with Jenkins, and project management and defect tracking with JIRA (Zephyr).
• Conducted responsive testing using BrowserStack, Lambda Test and Blisk, ensuring optimal performance across various devices.
• Worked extensively on an existing Selenium automation framework built using Java, following the Page Object Model (POM) design pattern.

QA Engineer - Wolters Kluwer - Chandigarh

(2015-10 - 2018-03)

• Executed Regression, Integration, System, and Compatibility testing to ensure software quality.
• Led client requirement-gathering sessions; analysis improvements contributed to a 25% increase in project success rate.

Software Tester - Xequre Solutions - Chandigarh

(2011-11 - 2015-09)

• Started a career as a manual test engineer, testing applications such as YES, Next Pawn, Lone Star Realty.
• Prepared initial documents, SRS, summary reports and user manuals to support both internal and external stakeholders.
• Worked within the Waterfall Model, adhering to its structured and sequential development process.

Bachelor of Technology (B.Tech) - Information Technology - Punjab Technical University (2007 - 2011)

Senior Secondary - 12th - PSEB

Secondary - 10th - PSEB