Test Architect
Key Skills for This Role
Full Job Posting
Responsibilities
- Set and evolve the technical strategy for end-to-end (E2E) test automation across Heartflow's full pipeline, defining patterns, frameworks, and architecture that scale with the platform.
- Drive the AI-first approach to test automation: define how AI-assisted authoring, self-healing locators, AI generated spec driven test development and LLM-driven triage are adopted, evaluated, and rolled out across teams.
- Architect and own post-deployment testing capabilities, including production smoke, synthetic monitoring, and continuous validation against live environments.
- Design test depth and rigor calibrated to each software component's safety classification, ensuring higher-risk components receive deeper verification and evidence.
- Author the most complex and consequential test plans, protocols, and reports; set the standards and templates other engineers follow under our QMS.
- Lead tool validation strategy for test infrastructure and automation tooling, partnering with RA/QA to ensure validation evidence meets regulatory expectations.
- Architect, build, and continually improve UI and mobile automation including but not limited to Selenium and Playwright — driving stability, parallelism, observability, and reuse across products, including our WebGL-based 3D viewer and desktop clinical applications.
- Define API and integration testing standards using tools such as REST Assured, Postman, Karate, and contract testing where appropriate.
- Define testing standards for medical imaging and clinical data interoperability protocols, and for report/document output validation.
- Partner with engineering, product, and RA/QA leaders to translate complex requirements into verifiable test strategies with full traceability.
- Own the technical relationship between requirements management and traceability tooling, ensuring every automated test maps to a documented requirement and audit-ready evidence.
- Lead deep root-cause investigations on the highest-impact issues across distributed systems and drive systemic prevention of recurrence.
- Define how automated tests are integrated into CI/CD to deliver fast, reliable, actionable feedback to engineering teams.
- Serve as a primary technical owner for quality-related audits, CAPAs, and regulatory submissions, providing test evidence, traceability, and documentation.
- Mentor senior and mid-level engineers; lead technical reviews, raise the bar on quality engineering practices, and grow the team's technical depth.
- Help define hiring profiles and lead technical interviews for future Test Engineering hires and contractor partners.
- Influence cross-functional decisions on quality strategy, tooling investments, and engineering process improvements.
Qualifications
- 8–12 years of experience in software test engineering, SDET, or quality engineering roles, with a strong record as a hands-on technical leader who has personally architected automation frameworks.
- Required: Substantial experience testing Software as a Medical Device (SaMD) or other regulated medical device software, including ownership of test strategy on shipped products.
- Required: Deep working knowledge of medical device QMS practices and applicable standards (e.g., ISO 13485, IEC 62304, ISO 14971, 21 CFR Part 820), including test documentation, traceability, tool validation, and audit support.
- Required: Expert-level proficiency with Selenium / WebDriver and Playwright, including framework architecture, large-scale stability and flake reduction, and parallel execution at scale.
- Track record designing, scaling, and maintaining E2E automation frameworks covering complete workflows and complex system integrations.
- Experience setting test plan, protocol, and report standards in a regulated environment, with rigorous traceability across requirements, test cases, and evidence.
- Demonstrated leadership in adopting AI-assisted testing tools and techniques (e.g., AI-augmented authoring, self-healing automation, LLM-driven test generation or triage).
- Strong programming skills in at least one mainstream language used for automation (e.g., Python, TypeScript/JavaScript, Java, or C#); able to set coding standards for the test organization.
- Deep experience with API and contract testing approaches (REST Assured, Postman, Karate, Pact, or equivalent).
- Strong experience integrating automated tests into CI/CD pipelines and working with cloud environments such as AWS.
- Excellent analytical and debugging skills across distributed systems; able to participate in root-cause investigations on the most complex failures.
- Excellent written and verbal communication skills; able to influence engineers, leaders, and cross-functional partners.
- Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
Desired
Direct experience with requirements/traceability tooling such as Ketryx, Jama, or Polarion.
Experience with DICOM and/or HL7 protocols, or other clinical data interoperability standards.
Experience leading RA/QA partnerships during regulatory audits and inspections.
Experience defining test strategy for ML/AI systems, clinical validation workflows, or medical imaging products.
Experience validating complex visualizations (qualitative and quantitative) such as 3D models, overlays, and measurement views.
Experience automating legacy desktop applications (e.g., Windows/C++) using tools such as WinAppDriver.
Experience designing and managing diverse test datasets (synthetic, anonymized, adversarial).
Experience defining non-functional / performance testing strategy with tools such as k6, Locust, JMeter, or Gatling.
Experience with data-pipeline testing and microservices architectures at scale.
Demonstrated ability to define, own, and evolve actionable quality metrics.
A reasonable estimate of the base salary compensation range is $190,000 to $250,000, bonus, and equity. #LI-IB1
Heartflow is an Equal Opportunity Employer. We are committed to a work environment that supports, inspires, and respects all individuals and do not discriminate against any employee or applicant because of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, veteran status, or any other status protected under federal, state, or local law. This policy applies to every aspect of employment at Heartflow, including recruitment, hiring, training, relocation, promotion, and termination.
Positions posted for Heartflow are not intended for or open to third party recruiters / agencies. Submission of any unsolicited resumes for these positions will be considered to be free referrals.
Heartflow has become aware of a fraud where unknown entities are posing as Heartflow recruiters in an attempt to obtain personal information from individuals as part of our application or job offer process. Before providing any personal information to outside parties, please verify the following: A) all legitimate Heartflow recruiter email addresses end with “@heartflow.com” and B) the position described is found on our careers site at www.heartflow.com/about/careers/ .
About Heartflow
Heartflow is a public medical technology company providing clinicians AI-driven software to diagnose and manage coronary disease.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Heartflow
Territory Account Manager - Seattle, WA; Bellevue, WA; Everett, WA
Seattle, USA
Clinical Field Specialist, CT - Texas
Austin, USA
Territory Account Manager - North Denver, CO
Denver, USA
Territory Account Manager - Cherry Hill, NJ
Cherry Hill, USA
Payroll Analyst
Rohnert Park, USA
Territory Account Manager - North Chicago, IL
North Chicago, USA
Territory Account Manager - Atlantic City, NJ
Atlantic City, USA
Senior Regulatory Labeling Specialist
San Francisco, USA
Territory Account Manager - Seattle, WA; Bellevue, WA; Everett, WA
Seattle, USA