Software Engineer in Test - Python Automation
Technology
Austin, United States2 days agoUntil 12/19/2026
Full timeOn-site
Job description
Role: SDET - Python Automation
Location: Austin, TX - Onsite
Role: Fulltime
Job Description:
- Python ML side testing mainly.
- Eval pipelines (faithfulness, hallucination, task completion)
- LLM-as-a-Judge / rubric scoring
- Adversarial / safety testing (injection, jailbreak, PII)
- Trace / log / telemetry triage
- Synthetic data / persona generation
- Python
- LLM / agentic system exposure
- AI-assisted engineering (Claude Code, MCP)
- CI/CD gating
- QA automation depth
Keywords
PythonTest AutomationMachine Learning TestingEvaluation PipelinesLLM-as-a-JudgeRubric ScoringAdversarial TestingSafety TestingTrace and Log AnalysisTelemetry TriageSynthetic Data GenerationPersona GenerationLLM SystemsAgentic SystemsAI-Assisted EngineeringCI/CD GatingSoftware Development Engineer in TestSDETMachine LearningLLM
Interested in this role?