Software Engineering Researcher (Research Coding Tasks)
Role Overview
Paid, remote contract work turning published software engineering research research into coding tasks for frontier AI agents.
For PhD-level researchers and research engineers who publish and ship code.
Domain: Software Engineering Research (test generation, program repair, static analysis and mining software repositories)
Key Skills for This Role
Full Job Posting
Job Description
Paid, remote contract work turning published software engineering research research into coding tasks for frontier AI agents. For PhD-level researchers and research engineers who publish and ship code.
Domain: Software Engineering Research (test generation, program repair, static analysis and mining software repositories)
Requirements
- Experience: published research with released code in software engineering research
- Education: PhD in CS or a related field, completed or in progress
The work
You start from a recent paper with released code, ideally your own. You remove the code that implements the paper's core contribution and package the rest as a task where an AI agent must rebuild it and beat the authors' results on the paper's own benchmarks. You write the task statement, define held-out evaluation workloads and per-metric pass thresholds, and supply a hidden reference solution plus a second solution showing the bar can be beaten. Later, you review agent attempts on your task.
Pay
$80/hr. Each task takes a few hours.
Application process
- Candidates who meet the requirements and provide the requested materials will be prioritised for review. As part of this process we conduct thorough background checks. Please apply only if you meet these requirements.
Why Apply
Work with your own research in a new format
Fully remote, asynchronous and flexible
$80/hr, with each task taking a few hours
Responsibilities
- Turn a published paper with code into an agent-solvable research coding task
- Define held-out workloads, per-metric thresholds, a reference solution and a solution that beats the bar
- Review AI agent attempts on your task
Required Qualifications
- Published research at venues such as ICSE, FSE, ASE or ISSTA, or comparable
- Released code for at least one of your papers (GitHub or artifact link)
- PhD in computer science or a related field, completed or in progress
- Meets the experience and education bar described in Full Description
Preferred Qualifications
- First-author papers reporting measured improvements over a baseline
- Comfortable with Docker and reproducible benchmark setups
- Depth in test generation, program repair, static analysis and mining software repositories
About AfterQuery
AfterQuery is a research lab investigating the boundaries of artificial intelligence through novel datasets and experimentation. We believe great AI comes from exceptional, human-generated data.
We're backed by top investors, including Y Combinator and Box Group, and support all leading AI labs.
Apply today to contribute to pushing the frontier of AI.
About AfterQuery
AfterQuery is an AI applied research lab serving frontier model developers with training data and evaluation systems.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at AfterQuery
Computational Biology Researcher (Research Coding Tasks)
, USA
Algorithms and Theory Researcher (Research Coding Tasks)
, USA
Parallel Algorithms and HPC Researcher (Research Coding Tasks)
, USA
GPU Kernel and ML Systems Researcher (Research Coding Tasks)
, USA
Security Researcher (Research Coding Tasks)
, USA
Computational Biology Researcher (Research Coding Tasks)
, USA
Database Systems Researcher (Research Coding Tasks)
, USA
Algorithms and Theory Researcher (Research Coding Tasks)
, USA
Parallel Algorithms and HPC Researcher (Research Coding Tasks)
, USA
Robotics and RL Researcher (Research Coding Tasks)
, USA
GPU Kernel and ML Systems Researcher (Research Coding Tasks)
, USA