Software Engineer | Remote
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Work Snapshot
Type: Full-time
Location: Remote
Commitment: 10-40 hrs/week
Commission: $60-$90 per hour
What You'll Be Doing:
Design realistic, multi-step software engineering challenges to test AI coding agents.
Build reference solutions in Python with clear, verifiable answers.
Utilize AI coding assistants in daily workflows and assess their effectiveness.
Review and refine tasks created by peers for clarity and correctness.
Analyze AI agent failures to improve task design and model evaluation.
What We're Looking For:
MSc or PhD in computer science or a related STEM field, or equivalent practical experience.
Have strong relevant experience in research, research-engineering, or software engineering roles.
Proficiency in Python scripting and debugging with clean-code practices.
Fluency with version control systems, IDEs, and standard software development workflows.
Experience with AI coding assistants, prompt engineering, or agent workflows is preferred.
Application Process:
Submit your application through the Easy Apply button.
Each application will be reviewed against the role requirements.
Candidates who meet the requirements will receive an email with the next steps.
Follow the instructions provided in the email to complete the remainder of the application process.