{"schemaVersion":"jobsearcher.job.v1","id":"f59dd5b2e7a3c2156dccef8d","url":"https://jobsearcher.com/jobs/f59dd5b2e7a3c2156dccef8d","canonicalUrl":"https://jobsearcher.com/jobs/f59dd5b2e7a3c2156dccef8d","title":"Evaluation Engineer","description":"The role\nResearch designs evaluations; you make them run reliably. You’ll build the harnesses, graders and reporting that let a model be evaluated on hundreds of tasks across our environments, with results anyone can reproduce.\nWhat you’ll own\n\nThe evaluation harness: task loading, environment orchestration, model adapters, scoring.\nGraders and verifiers implemented with the environment and verifier engineers.\nRuns that are deterministic, resumable and cheap to repeat.\nDashboards and reports that researchers and customers read.\nDiscrepancies between runs, chased until they’re explained.\n\nWhat you bring\n\nStrong software engineering in Python with an eye for reliability.\nModel APIs, batch systems and asynchronous processing.\nYou care about reproducibility and know how to achieve it.\nComfort reading research code and making it production-grade.\n\nHelpful, not required\n\nOpen evaluation frameworks.\nContainers and cloud infrastructure.\n\n#J-18808-Ljbffr","company":"Reinforced Learning","rawCompany":"reinforced learning","city":"Tonawanda","state":"NY","isRemote":false,"isActive":true,"createdAt":"2026-11-04T04:52:48.498Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"17-2199.00","title":"Engineers, All Other","slug":"engineers-all-other"}],"industries":[{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541690","title":"Other Scientific and Technical Consulting Services","slug":"other-scientific-and-technical-consulting-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Evaluation Engineer","description":"The role\nResearch designs evaluations; you make them run reliably. You’ll build the harnesses, graders and reporting that let a model be evaluated on hundreds of tasks across our environments, with results anyone can reproduce.\nWhat you’ll own\n\nThe evaluation harness: task loading, environment orchestration, model adapters, scoring.\nGraders and verifiers implemented with the environment and verifier engineers.\nRuns that are deterministic, resumable and cheap to repeat.\nDashboards and reports that researchers and customers read.\nDiscrepancies between runs, chased until they’re explained.\n\nWhat you bring\n\nStrong software engineering in Python with an eye for reliability.\nModel APIs, batch systems and asynchronous processing.\nYou care about reproducibility and know how to achieve it.\nComfort reading research code and making it production-grade.\n\nHelpful, not required\n\nOpen evaluation frameworks.\nContainers and cloud infrastructure.\n\n#J-18808-Ljbffr","datePosted":"2026-11-04T04:52:48.498Z","dateModified":"2026-11-04T04:52:48.498Z","hiringOrganization":{"@type":"Organization","name":"Reinforced Learning","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Tonawanda","addressRegion":"NY","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"f59dd5b2e7a3c2156dccef8d"},"url":"https://jobsearcher.com/jobs/f59dd5b2e7a3c2156dccef8d"}}