Senior QA Engineer
Role Overview
The Senior QA Engineer will own quality across the product portfolio, including backend services, agent orchestration, and omnichannel communications.
The role focuses on building quality into development and testing AI agents for probabilistic outputs, reasoning behaviours, performance, and security.
Key Skills for This Role
Full Job Posting
About Keyloop
Keyloop connects dealers, manufacturers, technology suppliers, and car buyers through digital transformation products.
Its open technology platform links client systems, departments, and sites to improve efficiency, profitability, and customer experience.
Role overview
The Senior QA Engineer will own quality across the product portfolio, including backend services, agent orchestration, and omnichannel communications.
The role focuses on building quality into development and testing AI agents for probabilistic outputs, reasoning behaviours, performance, and security.
Responsibilities
- Own the quality strategy for an AI agent platform, including testing non-deterministic LLM-powered systems.
- Build and maintain automated unit, integration, API, and end-to-end test suites across TypeScript, Node.js, React, and Python.
- Develop evaluation frameworks for agent behaviour, reasoning quality, tool use, memory, and multi-step interactions.
- Test and validate web, messaging, voice, and other omnichannel communications.
- Define acceptance criteria with engineers to identify issues early.
- Champion quality by reviewing pull-request coverage and advocating for testability in system design.
- Use and help shape AI-assisted testing tools to accelerate coverage and surface issues.
Required qualifications
- Proven experience as a Senior QA Engineer on complex, production software products.
- Strong hands-on skills with test frameworks such as Playwright, Cypress, or Jest.
- Experience testing APIs, backend services, and databases such as PostgreSQL or similar.
- Clear understanding of testing non-deterministic systems.
- Experience designing and implementing QA strategy.
- Strong communication skills for articulating quality risks to technical and non-technical stakeholders.
Preferred qualifications
- Experience evaluating LLM or agentic systems, prompt behaviour, output quality, hallucination risks, or agent evaluation frameworks.
- Familiarity with performance, load, or chaos testing for real-time or event-driven systems.
- Background in automotive, dealership technology, or B2B SaaS.
- Exposure to AI-assisted development and testing tools such as GitHub Copilot, Cursor, or Claude Code.
About keyloop
Private automotive retail software provider serving car dealers and vehicle manufacturers across sales, service, marketing, and inventory.
Visit company websiteApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at keyloop
Learning Design Lead
Hyderabad, IND
Keyloop is seeking a Learning Design Lead to create and maintain learning pathways, workshops, and accessible learning resources for global audiences. The role also evaluates programme effectiveness, partners with subjec
Account Director
Reading, GBR
Keyloop is seeking an Account Director to own and grow relationships with automotive manufacturer organisations. The role covers territory planning, consultative solution selling, pipeline management, negotiations, custo
Senior Software Engineer
Petersfield, GBR
Keyloop is seeking a Senior Software Engineer to build customer-facing AI agents and omnichannel communication experiences across the full stack. The role requires strong TypeScript, Node.js, React, backend architecture,