Lead Research Engineer, Data Quality
Role Overview
Lead the data quality team at an AI and machine learning company focused on reinforcement learning environments and model evaluation. You will shape the systems and research practices that make training data useful for real-world AI agents.
Key Skills for This Role
Full Job Posting
About the Role
Lead the data quality team at an AI and machine learning company focused on reinforcement learning environments and model evaluation. You will shape the systems and research practices that make training data useful for real-world AI agents.
What You'll Do
Lead development of systems that evaluate tasks across reinforcement learning environments, synthetic data, benchmarks, and domain-specific workflows.
Set data quality strategy by establishing standards, building quality control systems, and designing experiments to assess agent outputs.
Develop scalable methods to validate synthetic data, including failure-mode analysis, task mutation checks, and trajectory audits.
Work with research engineers, domain experts, and data vendors to identify quality issues and improve data generation workflows.
Translate research insights into production tools, dashboards, validation pipelines, and feedback loops.
Develop team practices for recognizing training data that is genuinely useful, realistic, and reliable.
Mentor research engineers and uphold strong standards for technical rigor and execution.
What We're Looking For
At least 5 years of relevant research or engineering experience, including building AI/ML data evaluation or quality systems.
Experience leading technical projects or teams from problem definition through implementation and iteration.
Advanced proficiency in Python, Docker, and Linux environments.
Background in AI research, evaluation, post-training, benchmarks, synthetic data, or model evaluation infrastructure.
Strong judgment about training data quality, including whether tasks are realistic, learnable, diverse, reliable, and useful.
Experience designing metrics, experiments, and quality assurance processes, and translating research into production systems.
Experience working with subject-matter experts to scale domain judgment into review or data generation workflows.
Clear written communication, attention to detail, and comfort working independently in an early-stage startup environment.
Compensation & Benefits
Base salary: $130,000 to $225,000 annually. Visa sponsorship is available.
Location
- On-site in the United States.
Qualifications
- At least 5 years of relevant research or engineering experience, including building AI/ML data evaluation or quality systems.
- Experience leading technical projects or teams from problem definition through implementation and iteration.
- Advanced proficiency in Python, Docker, and Linux environments.
- Background in AI research, evaluation, post-training, benchmarks, synthetic data, or model evaluation infrastructure.
- Strong judgment about training data quality, including whether tasks are realistic, learnable, diverse, reliable, and useful.
- Experience designing metrics, experiments, and quality assurance processes, and translating research into production systems.
- Experience working with subject-matter experts to scale domain judgment into review or data generation workflows.
- Clear written communication, attention to detail, and comfort working independently in an early-stage startup environment.
- Compensation & Benefits
- Base salary: $130,000 to $225,000 annually. Visa sponsorship is available.
- Location
- On-site in the United States.
Responsibilities
- Lead development of systems that evaluate tasks across reinforcement learning environments, synthetic data, benchmarks, and domain-specific workflows.
- Set data quality strategy by establishing standards, building quality control systems, and designing experiments to assess agent outputs.
- Develop scalable methods to validate synthetic data, including failure-mode analysis, task mutation checks, and trajectory audits.
- Work with research engineers, domain experts, and data vendors to identify quality issues and improve data generation workflows.
- Translate research insights into production tools, dashboards, validation pipelines, and feedback loops.
- Develop team practices for recognizing training data that is genuinely useful, realistic, and reliable.
- Mentor research engineers and uphold strong standards for technical rigor and execution.
- At least 5 years of relevant research or engineering experience, including building AI/ML data evaluation or quality systems.
- Experience leading technical projects or teams from problem definition through implementation and iteration.
- Advanced proficiency in Python, Docker, and Linux environments.
- Background in AI research, evaluation, post-training, benchmarks, synthetic data, or model evaluation infrastructure.
- Strong judgment about training data quality, including whether tasks are realistic, learnable, diverse, reliable, and useful.
- Experience designing metrics, experiments, and quality assurance processes, and translating research into production systems.
- Experience working with subject-matter experts to scale domain judgment into review or data generation workflows.
- Clear written communication, attention to detail, and comfort working independently in an early-stage startup environment.
- Base salary: $130,000 to $225,000 annually. Visa sponsorship is available.
- On-site in the United States.
About Clera
AI-powered talent agent matching candidates to startup roles.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Clera
Robotics Engineer, Autonomous Systems
Indianapolis, USA
About the Role Join an engineering and R&D team developing autonomous drone delivery systems. You will design, integrate, and test robotic systems from prototype through field validation, helping enable safe and reliable
Account Executive
, USA
About the Role A growing AI-powered recruiting company is hiring an Account Executive to own the full B2B sales cycle, from discovery through close. You will work with the sales development team and help scale the go-to-
Operations Intern
, USA
About the Role Join the operations team at a technology company working in AI-powered recruiting. You will coordinate candidates and hiring managers from introductions through interviews, helping keep the hiring process
Robotics Engineer, Autonomous Systems
Indianapolis, USA
Account Executive
, USA
Operations Intern
, USA
Account Executive
Chicago, USA
Sales Development Representative
Salt Lake City, USA
Founding Product Engineer
San Francisco, USA
Technical Strategist
San Francisco, USA
Account Executive
Salt Lake City, USA