Senior Quality Assurance Engineer

Senior QA Automation Engineer (AI / LLM)

Key Points

• Hybrid in Abu Dhabi, 2 to 3 days a week onsite
• Own quality across cutting edge generative AI and conversational agent products
• Real LLM testing, hallucination, bias, toxicity and PII checks, golden sets, non deterministic assertions
• Senior role, 8 or more years in QA automation with genuine AI testing depth
• Arabic speaker essential
• Salary around 30,000 AED per month, with room for exceptional candidates

About The Client

The Role, Senior Qa Automation Engineer

Key Responsibilities

• Design and execute generative AI test scenarios, including exploratory testing for chatbot interactions, intent recognition, tone and edge case behaviour
• Build LLM test designs, prompt and grounding validation, golden sets and non deterministic assertions
• Run safety and quality checks for hallucination, bias, toxicity and PII leakage
• Validate structured and unstructured data outputs for consistency, accuracy and compliance
• Establish real time testing approaches including streaming data validation and API monitoring
• Collaborate with ML and NLP teams to define evaluation metrics for agent performance
• Integrate AI tools such as Copilot and Claude into the QA lifecycle to accelerate test design, documentation and defect analysis

Essential Experience

• 8 or more years in QA engineering, with proven automation testing experience
• 5 or more years testing data systems
• Strong experience using AI applications and LLM based assistants in testing
• In depth automation skills in JavaScript and Python
• API testing experience, manual and automated
• Familiarity with chatbot frameworks, LLMs and conversational testing
• Exposure to QA automation tools such as PyTest, Postman and dbt tests
• Strong analytical skills and attention to detail across data and agent behaviour
• Arabic speaker, this is essential given the team and the work
• Eligible to be employed full time in the UAE
• Nice to have: experience defining quality standards for generative AI in a regulated or high compliance environment

What'S On Offer

• Salary around 30,000 AED per month, with flexibility for exceptional candidates
• The chance to own quality engineering for frontier AI products at a serious AI organisation
• Work at the edge of LLM and conversational AI testing, where the discipline is still being defined
• Hybrid working, 2 to 3 days onsite in Abu Dhabi
• Genuine influence over how responsible, reliable AI gets shipped

To Apply