AI Tester (m/f/d)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
AI Tester (AI Validation & RAG Testing) Role Overview We are seeking an AI Tester to support the validation and quality assurance of AI-powered applications within a large enterprise environment.
Key Skills for This Role
Full Job Posting
Role Overview
We are seeking an AI Tester to support the validation and quality assurance of AI-powered applications within a large enterprise environment.
You will focus on evaluating AI model behaviour, ensuring response accuracy, and identifying risks such as hallucinations and model drift.
This role is critical in ensuring that AI systems are reliable, scalable, and fit for production use across multiple use cases.
Key Responsibilities
- Work closely with application teams to test and validate AI-driven solutions
- Perform RAG evaluation, including identification of hallucinations, inaccuracies, and grounding issues
- Detect and monitor model drift and response consistency over time
- Execute functional and exploratory testing of AI outputs
- Support stress and load testing scenarios by analysing system response under high user query volumes
- Validate AI responses against test datasets and benchmark expectations
- Collaborate with engineering teams to improve model performance and output quality
- Contribute to defining AI testing frameworks, metrics, and validation methodologies
Required Skills & Qualifications
- Experience in AI testing, QA, or data validation roles
- Strong understanding of LLMs, RAG systems, and AI behaviour
- Experience identifying hallucinations, bias, and model inconsistencies
- Familiarity with API testing tools (e.g., Postman)
- Understanding of performance and stress testing concepts
- Analytical mindset with strong problem-solving skills
- Ability to work in cross-functional Agile teams
- AI Tester in Abu Dhabi, United Arab Emirates
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Halian | Managed Services, Recruitment Agency & Contract Staffing
Network Engineer (m/f/d)
Abu Dhabi Emirate, UAE
Job Description Network Engineer Position Network Engineer Location Abu Dhabi, UAE Experience Required 7+ Years – Relevant Experience (Not Net Total Experience) Job Summary We are seeking an experienced Senior Network En
Data Engineer (m/f/d)
Abu Dhabi Emirate, UAE
Role Overview This role focuses on designing and building scalable data infrastructure to support advanced autonomous systems. The position is responsible for transforming large-scale multimodal sensor data into high-qua
Senior Engineer (m/f/d)
Abu Dhabi Emirate, UAE
Role Overview This role focuses on defining and advancing learning-based approaches for motion planning in autonomous systems. It involves setting the technical direction and delivering solutions that evolve from traditi
Security Analyst (m/f/d)
Dubai, UAE
Security Analyst 6 month extendable contract Sharjah - Office based Key Responsibilities Ensure continuous compliance with ISO 27001 standards through regular monitoring and maintenance. Perform risk assessments and
PMO Governance Lead (m/f/d)
Abu Dhabi Emirate, UAE
Key Responsibilities Programme Governance & Delivery Lead governance across all AI-related programme streams, covering the full lifecycle from initiation through to value realisation Establish and manage programme stru
Senior Solution Architect (Corporate Banking) (m/f/d)
Abu Dhabi Emirate, UAE
Senior Solution Architect (Corporate Banking) Role Overview We are seeking a highly experienced Senior Solution Architect to lead the design and delivery of enterprise-grade solutions within a complex corporate banking e
Software Engineer - Go (Golang) (m/f/d)
Dubai, UAE
Key Responsibilities Design, develop, and maintain scalable backend services and APIs using Go (Golang). Own and deliver major components of the system architecture end-to-end. Collaborate with product and engineering
Robotics Integration Engineer (m/f/d)
Abu Dhabi Emirate, UAE
An opportunity is available for a Robotics System Integration Engineer to contribute to the setup and rollout of a robotic vehicle system. This role focuses on combining hardware and software components—ranging from sens
Network Engineer (m/f/d)
Abu Dhabi Emirate, UAE
Data Engineer (m/f/d)
Abu Dhabi Emirate, UAE
Senior Engineer (m/f/d)
Abu Dhabi Emirate, UAE
Security Analyst (m/f/d)
Dubai, UAE
PMO Governance Lead (m/f/d)
Abu Dhabi Emirate, UAE
Senior Solution Architect (Corporate Banking) (m/f/d)
Abu Dhabi Emirate, UAE
Software Engineer - Go (Golang) (m/f/d)
Dubai, UAE
Robotics Integration Engineer (m/f/d)
Abu Dhabi Emirate, UAE