Karthik Kumar
QA Engineer – Manual & Automation Testing
Talent
HyderabadMember since November 18, 2026
JavaPythonPostmanDeepEvalPromptfooLLM EvaluationRed TeamingJenkinsGitHub ActionsGitJira
·
Hire this person
Send a job offer directly to this candidate
JavaPythonPostmanDeepEvalPromptfoo
About
QA Engineer with 3.5 years of experience in functional and regression testing of web applications in Agile teams, with defect tracking in Jira. Builds automation using Playwright, Java, Python,tests APIs with Postman, and integrates checks into CI/CD pipelines (Jenkins, GitHub Actions). Hands-on experience validating AI/LLM output accuracy against defined acceptance criteria using DeepEval and Promptfoo, which carries over directly to sentiment and classification validation.
Experience
Test Engineer (Manual & AI Testing) - Indium Software Pvt Ltd
(2023-03 - 2026-07)
- Executed functional and regression testing on Agile e-commerce projects; logged, triaged and tracked defects in Jira through resolution with developers.
- Led AI/LLM testing for enterprise chatbots (banking and customer support), validating response accuracy, context retention and compliance against defined acceptance criteria.
- Built automated LLM evaluation pipelines in Python using DeepEval and Promptfoo to check output quality (accuracy, faithfulness, hallucination).
- Developed multi-turn conversation validation frameworks to verify context accuracy across long interactions.
- Integrated automated evaluation runs into Jenkins CI/CD pipelines for continuous testing.
- Executed red teaming and adversarial testing aligned with MITRE ATLAS (jailbreak, prompt injection, data leakage).
- Identified critical hallucination and compliance risks in production systems; created reusable Promptfoo YAML frameworks for enterprise testing.
Education
B.Tech - Computer Science - REVA University (2019 - 2022)
Skills
QA EngineerManual & Automation Testing
