AI Tester (m/f/d)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
AI Tester (AI Validation & RAG Testing) Role Overview We are seeking an AI Tester to support the validation and quality assurance of AI-powered applications within a large enterprise environment.
Key Skills for This Role
Full Job Posting
Role Overview
We are seeking an AI Tester to support the validation and quality assurance of AI-powered applications within a large enterprise environment.
You will focus on evaluating AI model behaviour, ensuring response accuracy, and identifying risks such as hallucinations and model drift.
This role is critical in ensuring that AI systems are reliable, scalable, and fit for production use across multiple use cases.
Key Responsibilities
- Work closely with application teams to test and validate AI-driven solutions
- Perform RAG evaluation, including identification of hallucinations, inaccuracies, and grounding issues
- Detect and monitor model drift and response consistency over time
- Execute functional and exploratory testing of AI outputs
- Support stress and load testing scenarios by analysing system response under high user query volumes
- Validate AI responses against test datasets and benchmark expectations
- Collaborate with engineering teams to improve model performance and output quality
- Contribute to defining AI testing frameworks, metrics, and validation methodologies
Required Skills & Qualifications
- Experience in AI testing, QA, or data validation roles
- Strong understanding of LLMs, RAG systems, and AI behaviour
- Experience identifying hallucinations, bias, and model inconsistencies
- Familiarity with API testing tools (e.g., Postman)
- Understanding of performance and stress testing concepts
- Analytical mindset with strong problem-solving skills
- Ability to work in cross-functional Agile teams
- AI Tester in Abu Dhabi, United Arab Emirates
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Halian | Managed Services, Recruitment Agency & Contract Staffing
QA Engineer - banking (m/f/d)
Abu Dhabi Emirate, UAE
QA Engineer- Banking We are seeking a highly skilled QA Engineer with strong experience in web automation and API testing to join a leading enterprise programme within the banking sector. This is a hands-on role requirin
Document Controller (m/f/d)
Abu Dhabi Emirate, UAE
Job Title: Document Controller Location: Abu Dhabi, UAE Department: Project Management / Engineering / Operations Reporting To: Project Manager / Document Control Manager Job Purpose The Document Controller is responsibl
Infrastructure Architect (m/f/d)
Abu Dhabi Emirate, UAE
We are seeking a highly experienced Senior Infrastructure Architect to lead the design, implementation, and optimization of large-scale, mission-critical on-premises infrastructure environments. This role is ideal for a
Senior Juniper Network Architect (m/f/d)
Dubai, UAE
A leading global IT infrastructure services company, specializing in managing, modernizing, and transforming mission‑critical enterprise technology environments, is seeking a highly skilled and proactive professional to
Quality Assurance Engineer
Abu Dhabi Emirate, UAE
Halian is hiring QA Engineer in Abu Dhabi. Greetings! Experience required: 7+ Years Duration: 6 months & extendable Required Skills: 7–12+ years of experience in QA and test automation. Strong hands-on expertise in Pla
Project Manager (m/f/d)
Abu Dhabi Emirate, UAE
Role Purpose The Project Manager is responsible for the end-to-end delivery of projects , ensuring they are completed on time, within scope, and within budget . The role involves managing project planning, execution, ris
PMO Lead (m/f/d)
Abu Dhabi Emirate, UAE
Overview Lead PMO governance, financial control, and portfolio coordination across complex robotics and engineering R&D programs, ensuring structured delivery and operational discipline. Responsibilities Establish and e
Cloud Ops & DevOps Lead (Azure) (m/f/d)
Abu Dhabi Emirate, UAE
Senior Platform Engineer (Azure) Role Overview We are seeking a Senior Platform Engineer to design, build, and scale Azure cloud and hybrid-cloud environments for a leading enterprise organisation. You will establish a r
QA Engineer - banking (m/f/d)
Abu Dhabi Emirate, UAE
Document Controller (m/f/d)
Abu Dhabi Emirate, UAE
Infrastructure Architect (m/f/d)
Abu Dhabi Emirate, UAE
Senior Juniper Network Architect (m/f/d)
Dubai, UAE
Quality Assurance Engineer
Abu Dhabi Emirate, UAE
Project Manager (m/f/d)
Abu Dhabi Emirate, UAE
PMO Lead (m/f/d)
Abu Dhabi Emirate, UAE
Cloud Ops & DevOps Lead (Azure) (m/f/d)
Abu Dhabi Emirate, UAE