{"schemaVersion":"jobsearcher.job.v1","id":"a609df6affcf4b791ff712eb","url":"https://jobsearcher.com/jobs/a609df6affcf4b791ff712eb","canonicalUrl":"https://jobsearcher.com/jobs/a609df6affcf4b791ff712eb","title":"Agent Evaluation Infrastructure Engineer","description":"Acerca del puesto Agent Evaluation Infrastructure EngineerSan Francisco, California | Primarily On-siteWe are seeking an Agent Evaluation Infrastructure Engineer to build the environments, evaluation systems, and supporting infrastructure used to train and assess long-horizon enterprise AI agents.The OpportunityYou will work on the engineering and research problems behind realistic agent environments, post-training systems, and reliable evaluation of complex multi-step workflows.Key ResponsibilitiesDesign evaluation environments for long-horizon enterprise agent workflows.Define tasks, state, tools, graders, and reward signals used to evaluate and improve agents.Build high-fidelity representations of complex enterprise software environments.Develop infrastructure for rollouts, orchestration, trajectory inspection, and grader pipelines.Measure both correctness and efficiency across multi-step agent behavior.Investigate evaluation failures, reward-quality issues, and agent behavior.Build production-quality systems rather than notebook-only research prototypes.Required QualificationsHands-on experience with AI environments, evaluations, reinforcement learning infrastructure, or related agent-training systems.Strong software engineering fundamentals.Demonstrated ability to build and ship technical infrastructure.Understanding of evaluation methodology, reward design, graders, and agent trajectories.Ability to work across languages and technology stacks based on system requirements.Candidate ProfileA PhD is not required. Strong engineering and shipped environment or evaluation systems are more important than academic credentials or publication history.SeniorityThe opportunity is open to exceptional new graduates, early-career engineers, and experienced senior candidates. Selection is based primarily on engineering strength and relevant technical work.Work ArrangementThe role is anchored in San Francisco with a strong preference for in-person collaboration. Limited flexibility may be considered case by case for exceptional candidates.","company":"Maxit Consulting","rawCompany":"maxit consulting","city":"Millbrae","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-11-06T13:43:37.936Z","occupations":[{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1221.00","title":"Computer and Information Research Scientists","slug":"computer-and-information-research-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Agent Evaluation Infrastructure Engineer","description":"Acerca del puesto Agent Evaluation Infrastructure EngineerSan Francisco, California | Primarily On-siteWe are seeking an Agent Evaluation Infrastructure Engineer to build the environments, evaluation systems, and supporting infrastructure used to train and assess long-horizon enterprise AI agents.The OpportunityYou will work on the engineering and research problems behind realistic agent environments, post-training systems, and reliable evaluation of complex multi-step workflows.Key ResponsibilitiesDesign evaluation environments for long-horizon enterprise agent workflows.Define tasks, state, tools, graders, and reward signals used to evaluate and improve agents.Build high-fidelity representations of complex enterprise software environments.Develop infrastructure for rollouts, orchestration, trajectory inspection, and grader pipelines.Measure both correctness and efficiency across multi-step agent behavior.Investigate evaluation failures, reward-quality issues, and agent behavior.Build production-quality systems rather than notebook-only research prototypes.Required QualificationsHands-on experience with AI environments, evaluations, reinforcement learning infrastructure, or related agent-training systems.Strong software engineering fundamentals.Demonstrated ability to build and ship technical infrastructure.Understanding of evaluation methodology, reward design, graders, and agent trajectories.Ability to work across languages and technology stacks based on system requirements.Candidate ProfileA PhD is not required. Strong engineering and shipped environment or evaluation systems are more important than academic credentials or publication history.SeniorityThe opportunity is open to exceptional new graduates, early-career engineers, and experienced senior candidates. Selection is based primarily on engineering strength and relevant technical work.Work ArrangementThe role is anchored in San Francisco with a strong preference for in-person collaboration. Limited flexibility may be considered case by case for exceptional candidates.","datePosted":"2026-11-06T13:43:37.936Z","dateModified":"2026-11-06T13:43:37.936Z","hiringOrganization":{"@type":"Organization","name":"Maxit Consulting","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Millbrae","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"a609df6affcf4b791ff712eb"},"url":"https://jobsearcher.com/jobs/a609df6affcf4b791ff712eb"}}