Skip to main content

Software Engineer in Test - Python Automation

Technology
Programmers.io
Austin, United States2 days agoUntil 12/19/2026
Full timeOn-site

Job description

Role: SDET - Python Automation

Location: Austin, TX - Onsite

Role: Fulltime

Job Description:

  • Python ML side testing mainly.
  • Eval pipelines (faithfulness, hallucination, task completion)
  • LLM-as-a-Judge / rubric scoring
  • Adversarial / safety testing (injection, jailbreak, PII)
  • Trace / log / telemetry triage
  • Synthetic data / persona generation
  • Python
  • LLM / agentic system exposure
  • AI-assisted engineering (Claude Code, MCP)
  • CI/CD gating
  • QA automation depth
Keywords
PythonTest AutomationMachine Learning TestingEvaluation PipelinesLLM-as-a-JudgeRubric ScoringAdversarial TestingSafety TestingTrace and Log AnalysisTelemetry TriageSynthetic Data GenerationPersona GenerationLLM SystemsAgentic SystemsAI-Assisted EngineeringCI/CD GatingSoftware Development Engineer in TestSDETMachine LearningLLM

Interested in this role?

Similar jobs