Automation Testing + AI Model Assurance
Role Overview
Seeking an experienced Automation Testing + AI Model Assurance Engineer.
The role assures quality, reliability, performance, and governance for AI-powered applications and conversational systems.
Work includes automation framework design, AI model validation, conversational AI testing, risk identification, and collaboration on product releases.
Key Skills for This Role
Full Job Posting
Job summary
Seeking an experienced Automation Testing + AI Model Assurance Engineer.
The role assures quality, reliability, performance, and governance for AI-powered applications and conversational systems.
Work includes automation framework design, AI model validation, conversational AI testing, risk identification, and collaboration on product releases.
Must-have skills
- Automation testing using Selenium, Playwright, Cypress, or an equivalent framework.
- API testing with tools such as Postman, REST Assured, or SoapUI.
- AI/ML model validation and testing; conversational AI testing for chatbots, virtual assistants, and LLMs.
- Test automation framework development; functional and regression testing.
- Python or Java; defect management and test reporting.
- Prompt testing and response validation; Agile/Scrum methodology.
Responsibilities
- Validate and assure the quality, reliability, performance, and governance of AI-powered applications and conversational systems.
- Design test automation frameworks.
- Validate AI model behavior and test conversational AI experiences.
- Identify model risks and collaborate with cross-functional teams to support high-quality AI product releases.
Requirements
- Strong expertise in test automation frameworks is required; Selenium, Playwright, Cypress, or an equivalent framework is listed.
- Expertise in API testing is required; Postman, REST Assured, or SoapUI are listed tools.
- Experience with AI/ML model validation and testing is required.
- Experience testing conversational AI, including chatbots, virtual assistants, or LLMs, is required.
- Test automation framework development expertise is required.
- Functional and regression testing expertise is required.
- Proficiency in Python or Java is required.
- Defect management and test reporting skills are required.
- Prompt testing and response validation expertise is required.
- Experience with Agile/Scrum methodology is required.
- The job summary seeks an experienced candidate; no specific years of experience are stated.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Cognizant
Data Governance Analyst
Toronto, CAN
Cognizant is seeking a Data Governance Analyst to operationalize enterprise governance practices and improve data quality, transparency, and compliance. The role includes maintaining governance artifacts, supporting stew
ITSM Consultant
Milton Keynes, GBR
Cognizant is seeking an ITSM Business Analyst/Consultant to shape service management strategy, redesign processes and support ServiceNow-enabled transformation. The work includes discovery, requirements, roadmaps, implem
Azure Business Data Analyst (Hybrid)
Toronto, CAN
Cognizant is seeking an experienced Business Data Analyst to bridge banking stakeholders and data technology teams on cloud data engineering, migration, analytics, and modernization initiatives. Candidates need 5+ years
Salesforce Business Analyst
Toronto, CAN
Cognizant is seeking an experienced Salesforce Business Analyst to help deliver Salesforce projects with business and technical teams. The role covers requirements, solution delivery support, testing, integrations, repor
Workday Reporting & Prism Principal Consultant
London, GBR
Cognizant is seeking a senior functional consultant to lead Workday Reporting and Prism Analytics solution design and delivery. Applicants need five or more years of Workday implementation experience, deep reporting and
Consulting Manager, P&C Insurance- Claims transformation
Mississauga, CAN
Cognizant is seeking a consulting manager to lead claims-transformation work for property and casualty insurers, from initiative roadmaps and business cases through solution design and delivery readiness. Applicants need
Cyber Security Solutions Sales Specialist (Canada)
Halifax, CAN
Cognizant is seeking a Cyber Security Solutions Sales Specialist to grow cybersecurity revenue, develop client opportunities, and lead complex pursuits. The role requires 15+ years of overall experience, including 10+ ye
Salesforce Business Analyst
Toronto, CAN
Cognizant seeks an experienced Salesforce Business Systems Analyst to gather requirements, shape solutions, and support Salesforce project delivery with business and technical teams. The role includes user stories, proce
Data Governance Analyst
Toronto, CAN
ITSM Consultant
Milton Keynes, GBR
Azure Business Data Analyst (Hybrid)
Toronto, CAN
Salesforce Business Analyst
Toronto, CAN
Workday Reporting & Prism Principal Consultant
London, GBR
Consulting Manager, P&C Insurance- Claims transformation
Mississauga, CAN
Cyber Security Solutions Sales Specialist (Canada)
Halifax, CAN
Salesforce Business Analyst
Toronto, CAN