AI Tester (m/f/d)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
AI Tester (AI Validation & RAG Testing) Role Overview We are seeking an AI Tester to support the validation and quality assurance of AI-powered applications within a large enterprise environment.
Key Skills for This Role
Full Job Posting
Role Overview
We are seeking an AI Tester to support the validation and quality assurance of AI-powered applications within a large enterprise environment.
You will focus on evaluating AI model behaviour, ensuring response accuracy, and identifying risks such as hallucinations and model drift.
This role is critical in ensuring that AI systems are reliable, scalable, and fit for production use across multiple use cases.
Key Responsibilities
- Work closely with application teams to test and validate AI-driven solutions
- Perform RAG evaluation, including identification of hallucinations, inaccuracies, and grounding issues
- Detect and monitor model drift and response consistency over time
- Execute functional and exploratory testing of AI outputs
- Support stress and load testing scenarios by analysing system response under high user query volumes
- Validate AI responses against test datasets and benchmark expectations
- Collaborate with engineering teams to improve model performance and output quality
- Contribute to defining AI testing frameworks, metrics, and validation methodologies
Required Skills & Qualifications
- Experience in AI testing, QA, or data validation roles
- Strong understanding of LLMs, RAG systems, and AI behaviour
- Experience identifying hallucinations, bias, and model inconsistencies
- Familiarity with API testing tools (e.g., Postman)
- Understanding of performance and stress testing concepts
- Analytical mindset with strong problem-solving skills
- Ability to work in cross-functional Agile teams
- AI Tester in Abu Dhabi, United Arab Emirates
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Halian | Managed Services, Recruitment Agency & Contract Staffing
Cyber Security and Threat Monitoring Specialist - SOC (m/f/d)
Abu Dhabi Emirate, UAE
Role Purpose The Cyber Security Operations (SOC) Specialist is responsible for monitoring the bank’s security environment, performing SIEM alert triage and investigation , and coordinating incident response activities al
SAP FICO Consultant (m/f/d)
Abu Dhabi Emirate, UAE
Job Title: SAP FICO Consultant (Techno-Functional – S/4HANA) Role Overview We are seeking a highly skilled Techno-Functional SAP FICO Consultant to lead and support the end-to-end S/4HANA implementation across a large gr
Security Analyst (m/f/d)
Dubai, UAE
Security Analyst 6 month extendable contract Sharjah - Office based Key Responsibilities Ensure continuous compliance with ISO 27001 standards through regular monitoring and maintenance. Perform risk assessments and
Enterprise Architect (m/f/d)
Dubai, UAE
Responsibilities Establish and run the CCoE (governance, brokerage, transformation) Define Azure landing zone and architecture standards Drive workload strategy (migrate, modernise, SaaS, retire) Create migration pla
Senior Cloud Solutions Architect (Hybrid Cloud) (m/f/d)
Abu Dhabi Emirate, UAE
Senior Cloud Solutions Architect (Hybrid Cloud) Role Overview We are seeking a Senior Cloud Solutions Architect to design secure, scalable, and compliant hybrid cloud solutions across multi-cloud environments. Key Respon
Software Engineer - Security (m/f/d)
Abu Dhabi Emirate, UAE
Role Purpose The Software Engineer is responsible for ensuring the secure and timely deployment of patches and updates across mission-critical banking platforms. The role focuses on automating regression testing , remedi
AI Tester (m/f/d)
Abu Dhabi Emirate, UAE
AI Tester A forward-thinking organisation is investing in the development of intelligent conversational AI solutions and is seeking a hands-on AI Tester to ensure the quality, reliability, and performance of a customer-f
Linux Administrator (m/f/d)
Abu Dhabi Emirate, UAE
Role Purpose The Linux Administrator is responsible for managing and securing enterprise Linux environments, ensuring systems are patched, hardened, and compliant with industry standards such as CIS Benchmarks and DISA S
Cyber Security and Threat Monitoring Specialist - SOC (m/f/d)
Abu Dhabi Emirate, UAE
SAP FICO Consultant (m/f/d)
Abu Dhabi Emirate, UAE
Security Analyst (m/f/d)
Dubai, UAE
Enterprise Architect (m/f/d)
Dubai, UAE
Senior Cloud Solutions Architect (Hybrid Cloud) (m/f/d)
Abu Dhabi Emirate, UAE
Software Engineer - Security (m/f/d)
Abu Dhabi Emirate, UAE
AI Tester (m/f/d)
Abu Dhabi Emirate, UAE
Linux Administrator (m/f/d)
Abu Dhabi Emirate, UAE