Sari la conținutul principal

Agentic QA Solution Architect

Technology
acum 1 săptămână
Normă întreagăLa sediu

Descrierea postului

HCLTech is a global technology company, home to 220,000+ people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services.

Our purpose is to bring together the best of technology and our people to supercharge progress. We’re supercharging progress for everyone, everywhere – our clients, partners and their stakeholders, our people, communities, and the planet.

About the Role

AI agents are non-deterministic: the same input can produce different outputs across runs. Testing them requires a fundamentally different discipline than scripted test automation - evaluation frameworks, scoring functions, and statistical judgment instead of exact-match assertions. As an Agentic QA Engineer, you will bring that discipline directly to our customers.

This is a forward-deployed, customer-facing engineering role. You will work side by side with enterprise customers to design, build, test, and harden agentic workflows in their live environments - combining the hands-on coding of a software engineer, the quality mindset of a test automation expert, and the end-to end design perspective of a solution architect.

Requirements:

  • Software engineering foundation. 7+ years of hands-on software development experience in Python, C#, VB.NET, or comparable languages, with the ability to write production-quality code and test harnesses.
  • Testing and QA depth. 3+ years in software testing / test automation, including test strategy design, automated test frameworks, and CI/CD-integrated quality gates.
  • Hands-on experience with AI agents. Practical experience building, deploying, or testing LLM-based agents and agentic workflows (e.g., tool/function calling, RAG, multi-step orchestration, frameworks such as LangChain/LangGraph or the Model Context Protocol), ideally in customer or production settings.
  • LLM evaluation literacy. Working understanding of non-determinism, prompting, grounding, and hallucination, and experience setting up evals - including LLM-as-judge approaches, rubric-based scoring, and regression testing of model or prompt changes.
  • Customer-facing experience. Proven track record in a forward-deployed, professional services,
implementation, or consulting role: leading technical workshops, managing stakeholder expectations, and delivering under real-world constraints in customer environments.
  • Solution architecture background. Experience designing end-to-end solutions across applications, APIs, and automation platforms - able to see the whole system, not just the component under test.
  • Communication. Excellent written and verbal communication; comfortable presenting technical findings and quality risks to executive stakeholders. Fluent English.

Nice to have (Preferred):

  • Experience with agentic testing or AI-augmented QA platforms (e.g., UiPath Test Cloud / Test Manager, or comparable AI-powered testing tools) and with automation platforms more broadly (RPA, workflow orchestration).
  • Experience with evaluation and observability tooling for LLM applications (e.g., LangSmith, Braintrust, Promptfoo, or custom pytest-based eval harnesses) and with tracing/monitoring agent behavior in production.
  • Statistical literacy - able to distinguish signal from noise in non-deterministic outputs and reason about sample sizes, baselines, and confidence.
  • Experience with test management and ALM tooling (e.g., ADO, Jira - Xray, TestRail, Test Manager) and requirements-to-test traceability.
  • Knowledge of AI governance, safety, and compliance considerations for deploying agents in regulated industries.
  • Degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
  • Willingness to travel to customer sites as needed.
Why Us?
  • We are investing in your growth, offering learning and career development opportunities at every level to help you find your spark;
  • We offer a virtual-first work environment, promoting a good work-life balance and real flexibility;
  • Our company is extremely diverse with representation of 165 nationalities;
  • We offer the opportunity to work with colleagues across the globe;
  • We offer comprehensive benefits for all employees;
  • We are a certified great place to work and a top employer in 25 countries including Romania, offering a positive work environment that values employee recognition and respect;
What do we offer?
  • 1066 RON monthly budget in Benefit Online Platform
  • 25 vacation days/year.
  • Life Insurance cover.
  • The employees working on bank holidays will benefit either a paid day off in the next 30 days + 100% of the hourly base salary for that specific day OR 200% of the hourly base salary for that specific day.
  • Childbirth allowance of 7000 RON after 1 year in HCLTech.
  • In the first 8 weeks, the company will pay the difference of up to 100% for the parental leave granted to pregnant employees.
  • Unfortunate events allowance of 7000 RON for first degree relative granted from day 1 in HCLTech.
  • Internal trainings and certifications.
HCLTech is committed to protecting and securing the privacy and confidentiality of the Personal Data which it collects directly or indirectly from you when applying for a job at HCLTech either directly or through a third-party human resources agency. This notice (the “Notice”) outlines and explains how HCL Technologies Limited including its subsidiaries, local employing entities, associates, and affiliated companies [collectively referred to as “HCLTech”, “us,” “our”, or “we”] will process your Personal Data in accordance with applicable privacy legislation(s).

Candidate Data Privacy Notice | HCLTech

Keywords
PythonC#VB.NETSoftware DevelopmentTest AutomationQuality AssuranceAI AgentsLLM EvaluationSolution ArchitectureCI/CDLangChainLangGraphModel Context ProtocolRAGCustomer-Facing ConsultingStatistical AnalysisAgentic QALLM ApplicationsEvaluation FrameworksLLM-as-Judge

Te interesează acest rol?