{"schemaVersion":"jobsearcher.job.v1","id":"aae56c793676c2d4af8adf20","url":"https://jobsearcher.com/jobs/aae56c793676c2d4af8adf20","canonicalUrl":"https://jobsearcher.com/jobs/aae56c793676c2d4af8adf20","title":"Full-Stack Engineer, Agent Evaluation & Reliability","description":"About the RoleJoin a small, technical team building AI agent evaluation and reliability infrastructure for enterprise customers. This backend-leaning full-stack role focuses on making agent performance measurable and improving the systems that support reliable AI products.\r\nWhat You'll DoBuild backend systems and data models for evaluation datasets, experiment runs, agent traces, knowledge versions, and quality criteria.Develop and operate enterprise integrations, including authentication, data syncing, retries, monitoring, and production support.Ship features across the stack, from technical design and implementation through deployment, monitoring, and iteration.Work with customers to diagnose system failures and turn their needs into reusable product capabilities.Build data pipelines and interfaces for collecting, analyzing, and visualizing evaluation results.What We're Looking ForAt least 3 years of experience building and shipping production systems as a full-stack engineer, ideally including work at a fast-paced startup.Hands-on machine learning model development experience, along with knowledge of evaluating and testing AI agents or other nondeterministic systems.Strong backend skills with TypeScript and Node.js or Bun, and experience building production frontend features.Strong PostgreSQL skills, including query optimization, and practical experience with Redis, job queues, background workers, or workflow systems.Experience designing APIs and backend services, building evaluation data pipelines, and developing dashboards or visualization interfaces.Familiarity with observability, monitoring, logging, and production troubleshooting.Compensation & BenefitsBase salary: $120,000 to $180,000 annually. Visa sponsorship is available.\r\nLocationOn-site in San Francisco, California, United States.#J-18808-Ljbffr","company":"True Talent Solutions Partners","rawCompany":"true talent solutions partners","city":"Millbrae","state":"CA","isRemote":false,"isActive":true,"createdAt":"2026-11-04T02:23:37.978Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1254.00","title":"Web Developers","slug":"web-developers"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Full-Stack Engineer, Agent Evaluation & Reliability","description":"About the RoleJoin a small, technical team building AI agent evaluation and reliability infrastructure for enterprise customers. This backend-leaning full-stack role focuses on making agent performance measurable and improving the systems that support reliable AI products.\r\nWhat You'll DoBuild backend systems and data models for evaluation datasets, experiment runs, agent traces, knowledge versions, and quality criteria.Develop and operate enterprise integrations, including authentication, data syncing, retries, monitoring, and production support.Ship features across the stack, from technical design and implementation through deployment, monitoring, and iteration.Work with customers to diagnose system failures and turn their needs into reusable product capabilities.Build data pipelines and interfaces for collecting, analyzing, and visualizing evaluation results.What We're Looking ForAt least 3 years of experience building and shipping production systems as a full-stack engineer, ideally including work at a fast-paced startup.Hands-on machine learning model development experience, along with knowledge of evaluating and testing AI agents or other nondeterministic systems.Strong backend skills with TypeScript and Node.js or Bun, and experience building production frontend features.Strong PostgreSQL skills, including query optimization, and practical experience with Redis, job queues, background workers, or workflow systems.Experience designing APIs and backend services, building evaluation data pipelines, and developing dashboards or visualization interfaces.Familiarity with observability, monitoring, logging, and production troubleshooting.Compensation & BenefitsBase salary: $120,000 to $180,000 annually. Visa sponsorship is available.\r\nLocationOn-site in San Francisco, California, United States.#J-18808-Ljbffr","datePosted":"2026-11-04T02:23:37.978Z","dateModified":"2026-11-04T02:23:37.978Z","hiringOrganization":{"@type":"Organization","name":"True Talent Solutions Partners","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Millbrae","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"aae56c793676c2d4af8adf20"},"url":"https://jobsearcher.com/jobs/aae56c793676c2d4af8adf20"}}