Software Developer
We work with AI labs that need someone with real engineering experience to judge what their models produce. We're looking for developers who read code the way they read their own: quickly, and with suspicion. Most of the job is reading. You get a task, a model's proposed solution, and sometimes a test suite. You decide whether the solution is correct, whether the tests prove it, and where the reasoning breaks down. Then you write the verdict in plain language, because a score without an explanation is just an opinion. You'll also help build the material the model is judged against: edge cases, tricky regressions, prompts that look simple and aren't. The best candidates notice the bug that compiles, passes, and is still wrong. What we need from you:3+ years shipping production code, in any language we can read. The habit of checking assumptions instead of trusting a diff. Writing clear enough that a stranger can follow your reasoning.10+ hours a week for 6 months or more.
Nice to have:
experience reviewing other people's code, a systems or security background, or having maintained something old and fragile. You'll be paid $45 to $55 an hour depending on experience, invoiced twice monthly. Onboarding is paid, and the first two weeks are structured rather than sink-or-swim. There is no exclusivity, so other contracts are fine as long as the work holds up. If you have ever left a review comment that saved a release, you will recognize this job.