Tooling Engineer
Role Overview
We are seeking highly qualified Domain Experts (SMEs) to support the evaluation, testing, and improvement of advanced Large Language Models (LLMs). You will apply your subject-matter expertise to assess AI-generated responses, identify knowledge gaps, design challenging prompts, and improve model accuracy, reliability, and reasoning.
Full Job Posting
About the Role
We are seeking highly qualified Domain Experts (SMEs) to support the evaluation, testing, and improvement of advanced Large Language Models (LLMs). You will apply your subject-matter expertise to assess AI-generated responses, identify knowledge gaps, design challenging prompts, and improve model accuracy, reliability, and reasoning.
Key Responsibilities
- Create complex, domain-specific prompts to test LLM capabilities.
- Evaluate AI-generated responses for factual accuracy, reasoning, relevance, and overall quality.
- Identify factual errors, logical inconsistencies, knowledge gaps, and model weaknesses.
- Develop challenging test cases and edge cases that expose model limitations.
- Provide clear, detailed, and evidence-based feedback to improve model performance.
Minimum Qualifications
- Master’s degree or higher in a relevant field.
- At least three years of professional, research, or teaching experience.
- Excellent written English communication skills.
- Strong analytical and critical-thinking abilities.
- Exceptional attention to detail.
Preferred Qualifications
- Experience working with LLMs or Generative AI.
- Familiarity with prompt engineering, AI evaluation, or model testing.
- Experience designing challenging prompts, identifying edge cases, or stress-testing AI models.
Ideal Candidate
The ideal candidate is curious, detail-oriented, and deeply knowledgeable in their field. They enjoy solving complex problems, challenging assumptions, and identifying subtle factual or reasoning errors. Experience designing prompts that uncover model limitations and improve AI performance will be a strong advantage.
About Turing
AI research accelerator and intelligent talent cloud platform.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Turing
Enterprise AI - Account Director - Consumer Packaged Goods
Dallas, USA
About Turing Turing’s mission is to accelerate superintelligence to drive real economic progress. Headquartered in San Francisco, Turing works with frontier AI labs to generate high-quality datasets, reinforcement learni
Field Engineer, AI Labs
San Francisco, USA
Enterprise AI - Account Director - Consumer Packaged Goods
Dallas, USA
Quality Analyst-Multimodality
, USA
Remote Pod Lead - Math
, IND
Quality Analyst - US
, USA
Senior Software Developer
, USA
Software Developer
, USA
Software Engineer
, USA