{bc}
Apply
workday

Clinical AI Fellow, AI, Digital & Data

PATH
GBR
Full-time
Junior · 2+ years experience
Onsite
Discovered 2 weeks ago
python

Full Job Posting

Responsibilities:

  • Bring Clinical Expertise to Evaluation
  • Contribute to evaluation design, including which AI systems we test, who we test them for, how we test them, and how we learn from our partners to refine our approach. Keep this all current as the field evolves.
  • Ground our simulated users/patients and automated (LLM) judges in clinical practice: help our partners specify personas and presentations and draft behaviour rubrics, and review transcripts for clinical errors before they go to the panels of clinicians and lived experience experts in each country. Expect to work hands-on alongside our partners.
  • Lead PATH’s evaluation of consumer AI products, from general-purpose assistants to dedicated mental health apps, while tailoring evaluations to specific populations, cultures, and languages. Coordinate with developers on evaluation of their models and products.
  • Co-author research on new methods for contextualised AI evaluation with consortium partners, bringing clinical expertise to how we build and validate simulated users/patients and LLM-judges.
  • Coordinate Delivery across the Consortium
  • Coordinate day-to-day delivery across our partners in South Africa, Kenya, Ghana, the UK, and the US (each of whom leads their own strand of the work): work with our ops team to track progress, organise working meetings, follow up on actions, and solve problems as they appear.
  • Matrix manage members of the AI4Health team supporting the delivery of consumer AI product evaluations, including both fellows doing their PhDs (whom you will contribute to the supervision of), as well as peers leading engineering for the programme.
  • Contribute to donor reports and to presentations for funders and external audiences.
  • Publish Evidence
  • Prepare content for a website presenting all results of PATH’s AI evaluations in mental health, including plain-language summaries for people seeking support; contribute to writing seminal reports on the state of AI safety and effectiveness for global mental health; and support presentation of evidence to international commissions and panels.
  • Write up our results for high-impact academic venues and established policy fora.
  • Contribute to the Broader AI programme
  • Support research and related activities led by other members of the AI team (where your expert skill set is relevant, and sometimes just as another pair of hands), including the soon-to-be-launched ‘Nature Commission on Consumer AI and Wellbeing’ for which PATH is hosting the secretariat.
  • This is a full-time post based in London. You’ll report to PATH’s Deputy Director for AI for Health. This role includes international travel to partner sites and convenings (around 10–15% of time).

Required Skills and Experience

  • Qualification as a clinical psychologist (DClinPsy or equivalent), or as a medical doctor with experience of, or a clear interest in, psychiatry.
  • At least two years’ clinical experience since qualifying as a clinical psychologist or doctor.
  • Research experience, with evidence of scientific writing (e.g., publications, preprints, or a doctoral thesis).
  • Expertise/experience in measurement and evaluation methods—reliability, validity, inter-rater agreement.
  • Some programming experience (e.g., Python or R), and hands-on use of LLMs (e.g., writing prompts, or writing and testing rubrics).
  • Excellent written and verbal communication for scientific, clinical, public, and policy audiences.
  • Ability to coordinate work and deadlines across complex, multi-stakeholder projects.

Preferred Qualifications

  • Research experience in digital mental health or experience evaluating digital health products (including their clinical safety).
  • Experience working with collaborators or patients in low- and middle-income countries, ideally in sub-Saharan Africa.
  • Experience coordinating a multi-partner or multi-site research program.
  • Research experience in simulating users or patients with LLMs, validating automated judges against human raters, or building LLM-based evaluation pipelines.
  • Experience of industry engagement and/or evaluation governance.
  • Experience working with lived experience or patient and public involvement panels.
  • We know great candidates won’t always meet every listed qualification. Research shows that some groups, on average, are more likely to self-select out if they feel they don’t meet all requirements. If you’re excited about the role and think you’d be a good fit, we encourage you to apply.
  • To be selected, you must have legal authorization to work in the United Kingdom.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at PATH

Monitoring and Evaluation Officer, South Asia Hub – Health Systems (Learning and Impact)

, IND

Discovered 2 days agoFull-time

Consultant, AI for Science – Knowledge Asset Design Product Development Division

, GBR

Discovered 3 days agoFull-time

Consultant, EPR Communications, Global Health Programs

, USA

Discovered 4 days agoFull-time

Intern- Digital Health, AI & MedTech

, IND

Discovered 1 weeks agoFull-time

Intern-Strategy & Business Development, Strategy team

New Delhi, IND

Discovered 1 weeks agoFull Time, Internship

Communications and Content Officer, Infectious Disease – Tuberculosis

Pune, IND

Discovered 1 weeks agoFull-time

Intern- Digital Health, AI & MedTech

New Delhi, IND

Discovered 1 weeks agoFull Time, Internship

Senior AI Fellow, Center for Vaccine Innovation and Access (CVIA)

, GBR

Discovered 1 weeks agoFull-time