Software Engineering PhD Expert, AI Agent Evaluation
Put your PhD to work at the frontier of AIBring the expertise you know best and help train the AI agents that do real technical work, on your own schedule, from anywhere. You'll turn problems from your software engineering research into hands-on challenges an AI agent has to solve at the command line, find exactly where it breaks, and set the expert standard it's measured against. Workada connects skilled contributors with meaningful AI work, and your judgment is what makes that work reliable. We're building a software engineering community of PhDs to test how far today's AI agents can go on real problems in the field, and we'd like you to be part of it.
What you'll do:
You'll take problems from your own research and turn each one into a self-contained task that an AI agent has to solve in a Linux terminal. For every task, you write a clear brief, set up the environment with the data and tools the agent needs, build a reference solution, and write automated checks on the final result. The strongest tasks are the ones today's best agents still get wrong, so your firsthand knowledge of where real software engineering work goes wrong is what makes them valuable. Specialties we're looking for If your PhD is in computer science or a closely related field (for example, computer engineering, mathematics, or electrical engineering), there's likely a place for you. We're building depth across programming languages, distributed systems, compilers, databases, operating systems, and software engineering, among others. Who we're looking for No AI or machine-learning background needed. Your software engineering expertise and your comfort working in a terminal are what we're after.
Requirements:
You hold, or are completing, a PhD in computer science or a closely related field (for example, computer engineering, mathematics, or electrical engineering).You've done computational work in your field and are comfortable in a Linux terminal: shell commands, scripting in Python or Bash, installing packages. You've used Docker, or can pick it up quickly. We share templates and worked examples. You can draw on your own research, code, and data as source material for your tasks. You have a precise, adversarial eye and enjoy finding the exact point where a workflow breaks, then explaining it cleanly. You're honest about uncertainty and write instructions that leave no room for misreading. You're based in the US or Canada. Background in systems programming, distributed systems, or developer tooling is a plus. Materials you can use Almost any part of your technical work can seed a task, for example: Analysis code, scripts, and pipelines from your research Datasets, supplementary files, and the processing behind them Figures and results you can reproduce from raw data Methods and protocols you've run computationally Bugs, edge cases, and failure modes you've had to debug yourself Repositories, build configurations, and failing test suites
What we offer:
- $100 to $150 per hour, based on your field and experience
- Weekly payouts through StripeRemote work from anywhere in the US or Canada
- Flexible schedule
Real people to work with: a 30-minute interview with someone in your field, and a Lead you can reach when questions come upWe're building this group now for projects starting in the coming weeks. If you're a match, we'll share the start date for your field as soon as we have it, and we won't ask you to hold time before work is ready.
Ready to apply? Join a community of PhDs setting the standard for AI agents in software engineering.
Workada is an Equal Opportunity Employer. We welcome applicants from all backgrounds.