Senior Python Engineer: AI Evaluation Architect (Remote)
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Mindrift is seeking Experienced software developers for a project-based role to build a dataset evaluating AI coding agents. You will craft realistic developer environments, define tasks, and write tests that accommodate multiple correct solutions while ensuring robustness.
Responsibilities include designing evaluation criteria, iterating with QA feedback, and collaborating with a team to deliver fair assessments. Strong Python, React, Docker, and data-workflow experience is valuable.