BUILDER 2 QA Engineer: Agentic QA and Reliability Engineer

Role overview

What the role owns

• Build a ticket-to-test pipeline that produces tests grounded in the actual application, requirements, and defects.
• Execute generated tests against real builds, stabilize them, and ensure they pass repeatedly before inclusion in the suite.
• Use risk coverage, mutation testing, and defect history rather than test counts alone.
• Improve test grounding, build adversarial testing approaches, develop test infrastructure, or automate legacy applications.

Profile and approach

• Write production-grade Python and build agents used by other engineers.
• Build, debug, and deploy autonomous agents, including LLM-driven test generation and browser-use agents.
• Use AI as a default workflow and evaluate tools for their value.
• Track false-positive and flake rates; rely on executed evidence rather than unrun generated tests.
• Work across modern web rewrites and legacy desktop applications.

Potential focus areas

• Possible areas of focus include test grounding, adversarial testing, prompt optimization with DSPy, fuzzing, test infrastructure, agent operations, and legacy surface automation.
• Examples of relevant business edge cases include fiscal calendars, multi-currency, partial shipments, and period-end adjustments.