Head of AI Safety
Key Skills for This Role
Full Job Posting
Requirements
- Essential:
- Experience in trust & safety, online harms, or a closely related field such as violence prevention, safeguarding, or public health, and the ability to adapt that knowledge to AI systems.
- Curiosity about AI and the ability to build technical fluency quickly, enough to engage credibly with technical counterparts at AI companies. Much of this work is new, so comfort learning as you go matters more than existing AI safety expertise.
- Experience designing research, evaluation frameworks, or interventions for harm categories such as violent extremism, CSEA, self-harm and crisis, or targeted violence.
- Demonstrated experience managing projects, teams, budgets, partners, and clients, with strong people management skills.
- Excellent written communication, with experience producing credible (not promotional) material for government, foundation, or enterprise audiences.
- Comfort and demonstrated resilience working with highly sensitive or graphic content (CSEA, extremist material, crisis content), with awareness of wellbeing practices for this kind of work.
- Strong judgment and the ability to navigate ambiguity, competing priorities, and sensitive stakeholder environments, including representing organizations externally.
- Willingness to travel and work outside regular hours where needed to accommodate clients or respond to incidents.
- Highly trustworthy, with discretion and diplomacy, and willing to undertake relevant security clearance procedures.
- Experience supporting business development, grant funding, or procurement.
- Commitment to Moonshot's mission.
- Candidates must be eligible to work in the US, and will be required to undertake and pass any relevant security clearance procedures per client needs.
- Desirable:
- Direct experience in model safety, red teaming, or adversarial evaluation of LLMs or other AI systems.
- Understanding of LLM architecture, safety tooling, or trust & safety policy.
- Prior experience in child safety evaluation, teen-safety product work, or grooming and CSEA detection.
- Familiarity with government or regulatory engagement, such as briefing officials or supporting policy submissions.
- Experience with intervention or diversion program design that can transfer to AI-mediated interventions.
- Academic or applied background in radicalization studies, forensic psychology, or violence risk assessment.
- Familiarity with taxonomy or classifier development, including how testing data feeds a classifier.
Benefits
- 15 days paid vacation leave, plus Federal holidays and 1 day additional paid leave for Native American Heritage Day.
- Flexible public holiday policy with the option to work federal holidays in exchange for a day off at another time.
- Full private healthcare package, including coverage for partners and children.
- Dental & Vision Insurance.
- Life & Disability Insurance.
- 24/7 access to free counseling via our Employee Assistance Program.
- 3% matched 401k contributions.
- 401(k) Roth Contributions.
- Generous maternity and paternity leave: 26 weeks paid maternity leave, 8 weeks paid paternity leave.
- All permanent employees are granted share options upon employment.
- Salary: $110,000 - $120,000 (depending on skills and experience).
About Moonshot
Countering online harms and extremism through data-driven technology.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Moonshot
Senior Manager, Digital Prevention & Interventions
Washington, USA
Project Assistant - Online Safeguarding Campaigns (Talent Pool)
London, GBR
Analyst - Online Gender-Based Violence Prevention
London, GBR
Analyst - Online Safeguarding Campaigns
London, GBR
Moonshot is hiring an Analyst to support digital prevention campaigns addressing online harms. The work includes campaign delivery and evaluation, research, data analysis, and project coordination; candidates need releva
Analyst - Online Gender-Based Violence Prevention
London, GBR
Moonshot is hiring an Analyst to support international online gender-based violence prevention programmes through digital campaigns, research and project coordination. The role involves analysing audience and campaign da
Senior Manager, Digital Prevention & Interventions
Washington, USA
Digital Advertising Manager
Washington, USA
Project Assistant - Online Safeguarding Campaigns (Talent Pool)
London, GBR
Analyst - Online Gender-Based Violence Prevention
London, GBR
Analyst - Online Safeguarding Campaigns
London, GBR
Analyst - Online Safeguarding Campaigns
London, GBR
Analyst - Online Gender-Based Violence Prevention
London, GBR
Senior Mobile Engineer (Consumer App)
, USA