AI Tester (m/f/d)

AI Tester

Responsibilities

• Design, develop, and execute comprehensive test plans and test cases covering functional, non-functional, integration, performance, and security testing across an AI chatbot platform.
• Perform black-box testing from the customer's perspective, evaluating chatbot behaviour, conversational accuracy, response quality, and user experience.
• Apply an understanding of AI and machine learning principles to assess chatbot outputs against expected behaviours and real-world customer expectations.
• Execute the full range of testing activities with a primary focus on functional and non-functional testing (approximately 75%), complemented by performance and security testing (approximately 25%).
• Conduct integration testing to validate seamless interaction between the chatbot and connected systems and APIs.
• Carry out performance testing to assess chatbot responsiveness, scalability, and stability under varied load conditions.
• Support security testing activities to identify vulnerabilities and ensure the platform meets required compliance and data protection standards.
• Utilise Azure-based testing tools and Python scripting to automate and enhance testing processes.
• Log, track, and clearly communicate defects and test outcomes, working closely with the Test Lead and development teams to drive resolution.
• Contribute technical analysis and insights to support continuous improvement of the chatbot's quality and performance.

Qualifications and Skills

• Up to 9 years of hands-on testing experience, with a strong focus on functional and non-functional testing.
• Proven experience designing test cases and test plans across multiple testing types — integration, performance, security, and functional.
• Black-box testing experience, ideally within a customer-facing digital or conversational AI product environment.
• Solid understanding of AI concepts and what constitutes quality, accuracy, and appropriate behaviour in an AI chatbot — practical development of AI is not required, but familiarity with AI capabilities and customer expectations is essential.
• Hands-on experience with Azure-based testing environments.
• Python scripting skills to support test automation and data validation.
• Strong analytical skills with the ability to interpret technical outputs and translate findings into clear, actionable reporting.
• Collaborative team player, comfortable operating within a structured team reporting to a Test Lead.
• Halian Group: With over 28 years of experience, we have come to understand that innovation is the only way to provide agile, practical solutions that transform businesses and careers.
• Our resourcing and smart services help you to realize tomorrow's potential.
• Discover the amazing things possible when you bring the right people and the right technologies together.
• At Halian, we recognise that diversity, equity, and inclusion (DEI) are essential to building high-performing teams for our clients.
• We are committed to connecting organisations with top talent from all backgrounds, ensuring that every individual feels valued, respected, and empowered to contribute their unique perspectives.
• We encourage applications from all qualified candidates, regardless of race, gender, disability, or any other characteristic that makes them unique.
• By fostering diverse and inclusive workplaces, we help our clients drive innovation, enhance collaboration, and better reflect the communities they serve.
• AI Tester in Abu Dhabi, United Arab Emirates