JOBSEARCHER

Software Engineers | $65/hr

Software Engineers – Paid Code Review for AI Agent Evaluation
Experience: Relevant Professional Software Engineering Experience
Job Type: Independent Contractor
Location: Remote
Compensation: $65/hour
Schedule: Flexible
Payment: WeeklyDomain: Software Engineering | Code Review | AI Evaluation | Testing
Role Overview: We are looking for experienced Software Engineers to review coding tasks and evaluation environments used to benchmark AI agents. The role involves assessing whether programming challenges, test cases, and evaluation harnesses accurately represent real-world software engineering scenarios.
Key Responsibilities: Review realistic programming tasks for accuracy and difficulty. Verify the logic and test cases within evaluation harnesses. Assess whether coding environments effectively measure software engineering skills. Review complex code structures and identify potential issues. Explain your technical reasoning during guided review sessions. Provide actionable feedback to improve task quality, realism, and evaluation accuracy.
Key Requirements: Professional experience as a Software Engineer / Developer. Strong code review, debugging, and testing skills. Experience building or maintaining test suites or evaluation harnesses. Familiarity with complex, real-world software architecture. Comfortable explaining technical concepts and engineering decisions. Ability to work independently in a remote environment.