Assistant Manager | Testing Automation | Hyderabad | Engineering as a Service/ Operate

Role Overview

Key Responsibilities

• Define and maintain QA strategy, test approach, and coverage for Power Platform and Copilot Studio solutions.
• Create, review, and execute test plans, test cases, and test scripts across SDLC phases.
• Perform functional, smoke, regression, integration, and end-to-end testing.
• Ensure traceability between requirements, test cases, defects, and releases.
• Validate Dataverse and Databricks tables, Power Automate flows, relationships, security roles, and data-integrity rules.
• Design and execute conversational test scenarios for multi-turn context, ambiguity handling, and error recovery.
• Perform regression testing for AI bot behavior changes caused by configuration, connector, or model updates.
• Test REST services, Azure ML endpoints, custom integrations, and data pipelines.
• Plan and execute performance and load tests for workflows and APIs using JMeter.
• Track defects and communicate test status, risks, and release readiness to stakeholders.
• Collaborate on acceptance criteria and non-functional requirements.
• Develop reusable test assets and automation frameworks.

Required Qualifications

• 3+ years of QA/testing experience, including 1-2 years testing Microsoft Power Platform solutions.
• Hands-on experience testing Power Automate workflows and data-centric applications.
• Working knowledge of Dataverse, connectors or custom connectors, Azure Databricks, and Azure Storage.
• Familiarity with Copilot Studio or chatbot testing methodologies, including NLU, multi-turn flows, and fallback handling.
• Strong knowledge of test design, execution, defect lifecycle, and reporting.
• REST API testing experience using Postman and/or scripted validation; Python is preferred.
• Performance testing experience using JMeter or LoadRunner, including analysis and reporting.
• Ability to validate AI/ML outputs and collaborate with data teams on statistical checks and model behavior.
• Basic understanding of prompts and edge cases for AI-agent evaluation.
• Develop and maintain automation scripts for API testing, regression suites, and chat-flow validation.
• Build automated chatbot-response validation using pattern matching, similarity scoring, or semantic validation where applicable.

Preferred Qualifications

• Microsoft Power Platform or Data Analytics/AI certifications are preferred.
• Cloud-based testing environment experience, preferably Azure, is preferred.
• Knowledge of accessibility, usability, and security testing is preferred.
• CI/CD pipeline and performance-testing integration exposure is preferred.
• Agile/Scrum experience with Azure DevOps pipelines for Power Platform or Copilot deployments is preferred.
• Understanding of responsible AI principles, LLM-based systems, prompt engineering, RAG architecture, and multi-agent workflows is preferred.

Tools and Technologies

• Azure DevOps.
• Postman.
• Selenium with Python automation.

Workplace

• Location type is hybrid.