Paid, remote contract work turning published software engineering research research into coding tasks for frontier AI agents. For PhD-level researchers and research engineers who publish and ship code.

Domain: Software Engineering Research (test generation, program repair, static analysis and mining software repositories) Requirements

Experience: published research with released code in software engineering research Education: PhD in CS or a related field, completed or in progress The work You start from a recent paper with released code, ideally your own. You remove the code that implements the paper's core contribution and package the rest as a task where an AI agent must rebuild it and beat the authors' results on the paper's own benchmarks. You write the task statement, define held-out evaluation workloads and per-metric pass thresholds, and supply a hidden reference solution plus a second solution showing the bar can be beaten.

Later, you review agent attempts on your task.

Pay $80/hr. Each task takes a few hours.

Application process Candidates who meet the requirements and provide the requested materials will be prioritised for review.



As part of this process we conduct thorough background checks. Please apply only if you meet these requirements.

Responsibilities

- Turn a published paper with code into an agent-solvable research coding task
- Define held-out workloads, per-metric thresholds, a reference solution and a solution that beats the bar
- Review AI agent attempts on your task

Required Qualifications

- Published research at venues such as ICSE, FSE, ASE or ISSTA, or comparable
- Released code for at least one of your papers (GitHub or artifact link)
- PhD in computer science or a related field, completed or in progress
- Meets the experience and education bar described in Full Description

Preferred Qualifications

- First-author papers reporting measured improvements over a baseline
- Comfortable with Docker and reproducible benchmark setups
- Depth in test generation, program repair, static analysis and mining software repositories

Why apply
- Work with your own research in a new format
- Fully remote, asynchronous and adaptable
- $80/hr, with each task taking a few hours

📌 Software Engineering Researcher (Research Coding Tasks) (España)
🏢 AfterQuery
📍 España