{"schemaVersion":"jobsearcher.job.v1","id":"1c93b7a77d4ce082b4a63f6a","url":"https://jobsearcher.com/jobs/1c93b7a77d4ce082b4a63f6a","canonicalUrl":"https://jobsearcher.com/jobs/1c93b7a77d4ce082b4a63f6a","title":"Software Engineering Researcher (Research Coding Tasks)","description":"Paid, remote contract work turning published software engineering research research into coding tasks for frontier AI agents. For PhD-level researchers and research engineers who publish and ship code. Domain: Software Engineering Research (test generation, program repair, static analysis and mining software repositories) RequirementsExperience: published research with released code in software engineering research Education: PhD in CS or a related field, completed or in progressThe work You start from a recent paper with released code, ideally your own. You remove the code that implements the paper's core contribution and package the rest as a task where an AI agent must rebuild it and beat the authors' results on the paper's own benchmarks. You write the task statement, define held-out evaluation workloads and per-metric pass thresholds, and supply a hidden reference solution plus a second solution showing the bar can be beaten. Later, you review agent attempts on your task. Pay $80/hr. Each task takes a few hours. Application process Candidates who meet the requirements and provide the requested materials will be prioritised for review. As part of this process we conduct thorough background checks. Please apply only if you meet these requirements.ResponsibilitiesTurn a published paper with code into an agent-solvable research coding taskDefine held-out workloads, per-metric thresholds, a reference solution and a solution that beats the barReview AI agent attempts on your taskRequired QualificationsPublished research at venues such as ICSE, FSE, ASE or ISSTA, or comparableReleased code for at least one of your papers (GitHub or artifact link)PhD in computer science or a related field, completed or in progressMeets the experience and education bar described in Full DescriptionPreferred QualificationsFirst-author papers reporting measured improvements over a baselineComfortable with Docker and reproducible benchmark setupsDepth in test generation, program repair, static analysis and mining software repositoriesWhy applyWork with your own research in a new formatFully remote, asynchronous and flexible$80/hr, with each task taking a few hours","company":"Afterquery","rawCompany":"afterquery","city":"Denver","state":"CO","isRemote":false,"isActive":false,"createdAt":"2026-10-31T07:53:17.194Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1251.00","title":"Computer Programmers","slug":"computer-programmers"},{"code":"15-1221.00","title":"Computer and Information Research Scientists","slug":"computer-and-information-research-scientists"}],"industries":[{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"541720","title":"Research and Development in the Social Sciences and Humanities","slug":"research-and-development-in-the-social-sciences-and-humanities"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Software Engineering Researcher (Research Coding Tasks)","description":"Paid, remote contract work turning published software engineering research research into coding tasks for frontier AI agents. For PhD-level researchers and research engineers who publish and ship code. Domain: Software Engineering Research (test generation, program repair, static analysis and mining software repositories) RequirementsExperience: published research with released code in software engineering research Education: PhD in CS or a related field, completed or in progressThe work You start from a recent paper with released code, ideally your own. You remove the code that implements the paper's core contribution and package the rest as a task where an AI agent must rebuild it and beat the authors' results on the paper's own benchmarks. You write the task statement, define held-out evaluation workloads and per-metric pass thresholds, and supply a hidden reference solution plus a second solution showing the bar can be beaten. Later, you review agent attempts on your task. Pay $80/hr. Each task takes a few hours. Application process Candidates who meet the requirements and provide the requested materials will be prioritised for review. As part of this process we conduct thorough background checks. Please apply only if you meet these requirements.ResponsibilitiesTurn a published paper with code into an agent-solvable research coding taskDefine held-out workloads, per-metric thresholds, a reference solution and a solution that beats the barReview AI agent attempts on your taskRequired QualificationsPublished research at venues such as ICSE, FSE, ASE or ISSTA, or comparableReleased code for at least one of your papers (GitHub or artifact link)PhD in computer science or a related field, completed or in progressMeets the experience and education bar described in Full DescriptionPreferred QualificationsFirst-author papers reporting measured improvements over a baselineComfortable with Docker and reproducible benchmark setupsDepth in test generation, program repair, static analysis and mining software repositoriesWhy applyWork with your own research in a new formatFully remote, asynchronous and flexible$80/hr, with each task taking a few hours","datePosted":"2026-10-31T07:53:17.194Z","dateModified":"2026-10-31T07:53:17.194Z","hiringOrganization":{"@type":"Organization","name":"Afterquery","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Denver","addressRegion":"CO","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"1c93b7a77d4ce082b4a63f6a"},"url":"https://jobsearcher.com/jobs/1c93b7a77d4ce082b4a63f6a"}}