AI Tester (m/f/d)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
AI Tester (AI Validation & RAG Testing) Role Overview We are seeking an AI Tester to support the validation and quality assurance of AI-powered applications within a large enterprise environment.
Key Skills for This Role
Full Job Posting
Role Overview
We are seeking an AI Tester to support the validation and quality assurance of AI-powered applications within a large enterprise environment.
You will focus on evaluating AI model behaviour, ensuring response accuracy, and identifying risks such as hallucinations and model drift.
This role is critical in ensuring that AI systems are reliable, scalable, and fit for production use across multiple use cases.
Key Responsibilities
- Work closely with application teams to test and validate AI-driven solutions
- Perform RAG evaluation, including identification of hallucinations, inaccuracies, and grounding issues
- Detect and monitor model drift and response consistency over time
- Execute functional and exploratory testing of AI outputs
- Support stress and load testing scenarios by analysing system response under high user query volumes
- Validate AI responses against test datasets and benchmark expectations
- Collaborate with engineering teams to improve model performance and output quality
- Contribute to defining AI testing frameworks, metrics, and validation methodologies
Required Skills & Qualifications
- Experience in AI testing, QA, or data validation roles
- Strong understanding of LLMs, RAG systems, and AI behaviour
- Experience identifying hallucinations, bias, and model inconsistencies
- Familiarity with API testing tools (e.g., Postman)
- Understanding of performance and stress testing concepts
- Analytical mindset with strong problem-solving skills
- Ability to work in cross-functional Agile teams
- AI Tester in Abu Dhabi, United Arab Emirates
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Halian | Managed Services, Recruitment Agency & Contract Staffing
PMO Governance Lead (m/f/d)
Abu Dhabi Emirate, UAE
Key Responsibilities Programme Governance & Delivery Lead governance across all AI-related programme streams, covering the full lifecycle from initiation through to value realisation Establish and manage programme stru
Salesforce Developer (m/f/d)
Dubai, UAE
Salesforce Developer 6 month extendable contract Remote working (must be able to work UAE hours) We are looking for a talented and experienced Salesforce Developer with 3+ years of hands-on experience in Salesforce dev
Senior Engineer - Decision Making (m/f/d)
Abu Dhabi Emirate, UAE
Position Overview This role focuses on the design and development of advanced decision-making frameworks for autonomous systems. It combines traditional logic-based approaches with modern machine learning techniques to c
PMO Lead (m/f/d)
Abu Dhabi Emirate, UAE
Overview Lead PMO governance, financial control, and portfolio coordination across complex robotics and engineering R&D programs, ensuring structured delivery and operational discipline. Responsibilities Establish and e
Project Manager (m/f/d)
Abu Dhabi Emirate, UAE
Project Manager Location: Abu Dhabi Experience Required: 8+ years About the Role: We are seeking a Project Manager with deep experience in digital transformation projects , especially in AI, cloud, smart city and data-re
System Engineer (m/f/d)
Sharjah, UAE
System Engineer 6 month extendable contract Sharjah - Office Based We are looking for a Systems Engineer with experience on managing the Azure Cloud. They should have: Experience with IaaS, PaaS and SaaS workloads Ex
Cyber Security and Threat Monitoring Specialist - SOC (m/f/d)
Abu Dhabi Emirate, UAE
Role Purpose The Cyber Security Operations (SOC) Specialist is responsible for monitoring the bank’s security environment, performing SIEM alert triage and investigation , and coordinating incident response activities al
Client Executive
Dubai, UAE
Ready to grow, and own your IT recruitment clients within a global technology‑focused brand? Join Halian , part of the NES Fircroft Group , as a Client Executive and take full ownership of delivering best‑in‑class recrui
PMO Governance Lead (m/f/d)
Abu Dhabi Emirate, UAE
Salesforce Developer (m/f/d)
Dubai, UAE
Senior Engineer - Decision Making (m/f/d)
Abu Dhabi Emirate, UAE
PMO Lead (m/f/d)
Abu Dhabi Emirate, UAE
Project Manager (m/f/d)
Abu Dhabi Emirate, UAE
System Engineer (m/f/d)
Sharjah, UAE
Cyber Security and Threat Monitoring Specialist - SOC (m/f/d)
Abu Dhabi Emirate, UAE
Client Executive
Dubai, UAE