Senior Software Development Engineer in Test, ML

Role overview

Responsibilities

• Drive architecture-level automation and scalable quality engineering across teams and product areas.
• Build and maintain automated test frameworks and scripts for ML inference services and platform components.
• Create representative test accounts and datasets; validate model distributions, rankings, output quality, and other signals before release.
• Perform functional, integration, regression, API, performance, and load tests, checking scalability, latency, and reliability.
• Partner with engineering and operations teams to automate feature and bug-fix coverage and support CI/CD.
• Debug test failures and model anomalies, report defects, establish quality practices, and optimize test execution and environments.

Required qualifications

• Bachelor's degree in Computer Science or a related field.
• At least five years of SDET experience, including strong backend testing experience.
• Proficiency in Python, Java, Scala, or Go for test automation.
• Hands-on API testing for distributed systems; Postman or similar tools are named as examples.
• Familiarity with CI/CD and test execution in Jenkins or similar environments, including GitHub Actions or ArgoCD.
• Hands-on framework experience such as pytest, JUnit, or TestNG, plus experience validating backend databases.
• Cloud/container experience such as AWS, GCP, Kubernetes, or Docker; familiarity with monitoring and observability tools.
• Strong SDLC and agile understanding, problem-solving, and communication skills.

Preferred qualifications

• Experience testing recommendation, search-ranking, or other probabilistic ML systems.
• Experience creating synthetic or seeded test data and evaluating outputs with statistical, distribution, or scenario-based methods.
• Knowledge of data pipelines, feature stores, inference systems, or model-serving infrastructure such as Seldon, KServe, or Ray Serve.
• Experience with performance/load testing, Databricks or similar ML platforms, or architecting CI/CD pipelines and quality gates.

Compensation

• Estimated Ontario base pay range is CAD $114,000–$143,000; individual pay may vary based on job-related factors and location.

Work arrangement

• The posting refers to a hybrid working policy.