{"schemaVersion":"jobsearcher.job.v1","id":"64b66ea7bd2ab9439aa1c5ed","url":"https://jobsearcher.com/jobs/64b66ea7bd2ab9439aa1c5ed","canonicalUrl":"https://jobsearcher.com/jobs/64b66ea7bd2ab9439aa1c5ed","title":"AI Engineer, RL & Evals","description":"About the companyOur client is a seed-stage AI company building the data and infrastructure layer to improve how AI models handle subjective work. Its initial focus is design, where it develops reinforcement learning environments and evaluation systems for creative output. The team works with frontier AI labs and application companies on training, evaluation, and product infrastructure.The role / why it mattersAs an AI Engineer focused on reinforcement learning and evaluations, you will build the systems that help models improve on tasks where there is no single objectively correct answer. This is a production engineering role at the intersection of backend development and applied machine learning, with ownership from environment design through shipped infrastructure.What you'll doBuild and scale reinforcement learning environments and evaluation frameworks for creative domains such as design.Design tasks and grading rubrics that measure quality in subjective domains.Develop agent harnesses and context layers for API and product infrastructure.Work with research teams to create environments that improve AI model output.Ship production software end to end, including backend systems and data pipelines.What we're looking forAt least two years of relevant engineering or applied machine learning experience.Experience building reinforcement learning environments, evaluation systems, or machine learning post-training systems.Strong backend or full-stack engineering experience shipping production products.Practical skills in Python and PyTorch, with working knowledge of reinforcement learning, LLMs, evaluation frameworks, and distributed systems.A computer science degree.Ability to collaborate across engineering and research and communicate fluently in English.Bonus pointsExperience building evaluations for creative, generative, or otherwise non-verifiable domains.Experience developing platforms or environments for agentic systems.Compensation and benefitsThe base salary range is $175,000 to $275,000 USD, plus competitive equity.Location / work modelThis is a full-time, on-site role in San Francisco, five days per week.","company":"Raydar","rawCompany":"raydar","city":"Millbrae","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-10-01T13:26:21.153Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1221.00","title":"Computer and Information Research Scientists","slug":"computer-and-information-research-scientists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"AI Engineer, RL & Evals","description":"About the companyOur client is a seed-stage AI company building the data and infrastructure layer to improve how AI models handle subjective work. Its initial focus is design, where it develops reinforcement learning environments and evaluation systems for creative output. The team works with frontier AI labs and application companies on training, evaluation, and product infrastructure.The role / why it mattersAs an AI Engineer focused on reinforcement learning and evaluations, you will build the systems that help models improve on tasks where there is no single objectively correct answer. This is a production engineering role at the intersection of backend development and applied machine learning, with ownership from environment design through shipped infrastructure.What you'll doBuild and scale reinforcement learning environments and evaluation frameworks for creative domains such as design.Design tasks and grading rubrics that measure quality in subjective domains.Develop agent harnesses and context layers for API and product infrastructure.Work with research teams to create environments that improve AI model output.Ship production software end to end, including backend systems and data pipelines.What we're looking forAt least two years of relevant engineering or applied machine learning experience.Experience building reinforcement learning environments, evaluation systems, or machine learning post-training systems.Strong backend or full-stack engineering experience shipping production products.Practical skills in Python and PyTorch, with working knowledge of reinforcement learning, LLMs, evaluation frameworks, and distributed systems.A computer science degree.Ability to collaborate across engineering and research and communicate fluently in English.Bonus pointsExperience building evaluations for creative, generative, or otherwise non-verifiable domains.Experience developing platforms or environments for agentic systems.Compensation and benefitsThe base salary range is $175,000 to $275,000 USD, plus competitive equity.Location / work modelThis is a full-time, on-site role in San Francisco, five days per week.","datePosted":"2026-10-01T13:26:21.153Z","dateModified":"2026-10-01T13:26:21.153Z","hiringOrganization":{"@type":"Organization","name":"Raydar","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Millbrae","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"64b66ea7bd2ab9439aa1c5ed"},"url":"https://jobsearcher.com/jobs/64b66ea7bd2ab9439aa1c5ed"}}