{"schemaVersion":"jobsearcher.job.v1","id":"425193d4897aecb25a3542e0","url":"https://jobsearcher.com/jobs/425193d4897aecb25a3542e0","canonicalUrl":"https://jobsearcher.com/jobs/425193d4897aecb25a3542e0","title":"Software Engineering PhD Expert, AI Agent Evaluation","description":"Put your PhD to work at the frontier of AIBring the expertise you know best and help train the AI agents that do real technical work, on your own schedule, from anywhere. You'll turn problems from your software engineering research into hands-on challenges an AI agent has to solve at the command line, find exactly where it breaks, and set the expert standard it's measured against. Workada connects skilled contributors with meaningful AI work, and your judgment is what makes that work reliable. We're building a software engineering community of PhDs to test how far today's AI agents can go on real problems in the field, and we'd like you to be part of it.What you'll doYou'll take problems from your own research and turn each one into a self-contained task that an AI agent has to solve in a Linux terminal. For every task, you write a clear brief, set up the environment with the data and tools the agent needs, build a reference solution, and write automated checks on the final result. The strongest tasks are the ones today's best agents still get wrong, so your firsthand knowledge of where real software engineering work goes wrong is what makes them valuable.Specialties we're looking forIf your PhD is in computer science or a closely related field (for example, computer engineering, mathematics, or electrical engineering), there's likely a place for you. We're building depth across programming languages, distributed systems, compilers, databases, operating systems, and software engineering, among others.Who we're looking forNo AI or machine-learning background needed. Your software engineering expertise and your comfort working in a terminal are what we're after.RequirementsYou hold, or are completing, a PhD in computer science or a closely related field (for example, computer engineering, mathematics, or electrical engineering).You've done computational work in your field and are comfortable in a Linux terminal: shell commands, scripting in Python or Bash, installing packages.You've used Docker, or can pick it up quickly. We share templates and worked examples.You can draw on your own research, code, and data as source material for your tasks.You have a precise, adversarial eye and enjoy finding the exact point where a workflow breaks, then explaining it cleanly.You're honest about uncertainty and write instructions that leave no room for misreading.You're based in the US or Canada.Background in systems programming, distributed systems, or developer tooling is a plus.Materials you can useAlmost any part of your technical work can seed a task, for example:Analysis code, scripts, and pipelines from your researchDatasets, supplementary files, and the processing behind themFigures and results you can reproduce from raw dataMethods and protocols you've run computationallyBugs, edge cases, and failure modes you've had to debug yourselfRepositories, build configurations, and failing test suitesWhat we offer$100 to $150 per hour, based on your field and experienceWeekly payouts through StripeRemote work from anywhere in the US or CanadaFlexible scheduleReal people to work with: a 30-minute interview with someone in your field, and a Lead you can reach when questions come upWe're building this group now for projects starting in the coming weeks. If you're a match, we'll share the start date for your field as soon as we have it, and we won't ask you to hold time before work is ready.Ready to apply? Join a community of PhDs setting the standard for AI agents in software engineering.Workada is an Equal Opportunity Employer. We welcome applicants from all backgrounds.","company":"Workada","rawCompany":"workada","city":"Denver","state":"CO","isRemote":false,"isActive":false,"createdAt":"2026-10-31T07:53:12.793Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1251.00","title":"Computer Programmers","slug":"computer-programmers"}],"industries":[{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Software Engineering PhD Expert, AI Agent Evaluation","description":"Put your PhD to work at the frontier of AIBring the expertise you know best and help train the AI agents that do real technical work, on your own schedule, from anywhere. You'll turn problems from your software engineering research into hands-on challenges an AI agent has to solve at the command line, find exactly where it breaks, and set the expert standard it's measured against. Workada connects skilled contributors with meaningful AI work, and your judgment is what makes that work reliable. We're building a software engineering community of PhDs to test how far today's AI agents can go on real problems in the field, and we'd like you to be part of it.What you'll doYou'll take problems from your own research and turn each one into a self-contained task that an AI agent has to solve in a Linux terminal. For every task, you write a clear brief, set up the environment with the data and tools the agent needs, build a reference solution, and write automated checks on the final result. The strongest tasks are the ones today's best agents still get wrong, so your firsthand knowledge of where real software engineering work goes wrong is what makes them valuable.Specialties we're looking forIf your PhD is in computer science or a closely related field (for example, computer engineering, mathematics, or electrical engineering), there's likely a place for you. We're building depth across programming languages, distributed systems, compilers, databases, operating systems, and software engineering, among others.Who we're looking forNo AI or machine-learning background needed. Your software engineering expertise and your comfort working in a terminal are what we're after.RequirementsYou hold, or are completing, a PhD in computer science or a closely related field (for example, computer engineering, mathematics, or electrical engineering).You've done computational work in your field and are comfortable in a Linux terminal: shell commands, scripting in Python or Bash, installing packages.You've used Docker, or can pick it up quickly. We share templates and worked examples.You can draw on your own research, code, and data as source material for your tasks.You have a precise, adversarial eye and enjoy finding the exact point where a workflow breaks, then explaining it cleanly.You're honest about uncertainty and write instructions that leave no room for misreading.You're based in the US or Canada.Background in systems programming, distributed systems, or developer tooling is a plus.Materials you can useAlmost any part of your technical work can seed a task, for example:Analysis code, scripts, and pipelines from your researchDatasets, supplementary files, and the processing behind themFigures and results you can reproduce from raw dataMethods and protocols you've run computationallyBugs, edge cases, and failure modes you've had to debug yourselfRepositories, build configurations, and failing test suitesWhat we offer$100 to $150 per hour, based on your field and experienceWeekly payouts through StripeRemote work from anywhere in the US or CanadaFlexible scheduleReal people to work with: a 30-minute interview with someone in your field, and a Lead you can reach when questions come upWe're building this group now for projects starting in the coming weeks. If you're a match, we'll share the start date for your field as soon as we have it, and we won't ask you to hold time before work is ready.Ready to apply? Join a community of PhDs setting the standard for AI agents in software engineering.Workada is an Equal Opportunity Employer. We welcome applicants from all backgrounds.","datePosted":"2026-10-31T07:53:12.793Z","dateModified":"2026-10-31T07:53:12.793Z","hiringOrganization":{"@type":"Organization","name":"Workada","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Denver","addressRegion":"CO","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"425193d4897aecb25a3542e0"},"url":"https://jobsearcher.com/jobs/425193d4897aecb25a3542e0"}}