{"schemaVersion":"jobsearcher.job.v1","id":"a624e60978f83dd096f12e66","url":"https://jobsearcher.com/jobs/a624e60978f83dd096f12e66","canonicalUrl":"https://jobsearcher.com/jobs/a624e60978f83dd096f12e66","title":"Product engineer, full stack","description":"Product Engineer — Full Stack Job DescriptionThe RoleJudgment is the learning infrastructure for AI agents. Agents in production don't improve from prompts alone. They improve from experience: the tasks they attempt, the mistakes they make, the edge cases they hit. Here's how it works:We ingest everything your agents do in production: traces, tool calls, decisions, outcomesJudgment turns that raw experience into structured signals: failure modes, behaviors, rubrics, evalsTeams close the loop, shipping agent improvements validated against real production evidenceYou'll own problems end-to-end: talking to customers, defining what to build, building it, and iterating until it's great. This is not a role where you implement specs handed down.What You Will AccomplishInvestigation interfaces: Design how engineers understand what their systems did and why. Long traces, tool calls, decisions, failures. How do you make a complex sequence of events legible in minutes?Verification: Build the platform for verifying system changes: hosted simulated environments, trajectory replay, and monitors for unintended behavior changes.The improvement loop: Build the workflows that turn production data into datasets, evaluations, and regression checks, so the path from \"found a problem\" to \"verified a fix\" feels like one motion.The platform underneath: Workspaces, roles, permissions, billing, usage, and limits for teams running many workflows across many environments.What You'll BringExperience building and scaling end-to-end production systems, from data layer to UIStrong technical problem-solving skills, especially in fast-changing, ambiguous environmentsA builder and tinkerer's mindset with high agency - you find creative ways to overcome obstacles and shipComfort working directly with customers to understand their needs and solve real-world problemsExcellent communication skills - clear, direct, and persuasive across technical and non-technical audiences","company":"Judgment Labs","rawCompany":"judgment labs","city":"Millbrae","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-08-17T11:55:37.893Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"17-2112.02","title":"Validation Engineers","slug":"validation-engineers"}],"industries":[{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Product engineer, full stack","description":"Product Engineer — Full Stack Job DescriptionThe RoleJudgment is the learning infrastructure for AI agents. Agents in production don't improve from prompts alone. They improve from experience: the tasks they attempt, the mistakes they make, the edge cases they hit. Here's how it works:We ingest everything your agents do in production: traces, tool calls, decisions, outcomesJudgment turns that raw experience into structured signals: failure modes, behaviors, rubrics, evalsTeams close the loop, shipping agent improvements validated against real production evidenceYou'll own problems end-to-end: talking to customers, defining what to build, building it, and iterating until it's great. This is not a role where you implement specs handed down.What You Will AccomplishInvestigation interfaces: Design how engineers understand what their systems did and why. Long traces, tool calls, decisions, failures. How do you make a complex sequence of events legible in minutes?Verification: Build the platform for verifying system changes: hosted simulated environments, trajectory replay, and monitors for unintended behavior changes.The improvement loop: Build the workflows that turn production data into datasets, evaluations, and regression checks, so the path from \"found a problem\" to \"verified a fix\" feels like one motion.The platform underneath: Workspaces, roles, permissions, billing, usage, and limits for teams running many workflows across many environments.What You'll BringExperience building and scaling end-to-end production systems, from data layer to UIStrong technical problem-solving skills, especially in fast-changing, ambiguous environmentsA builder and tinkerer's mindset with high agency - you find creative ways to overcome obstacles and shipComfort working directly with customers to understand their needs and solve real-world problemsExcellent communication skills - clear, direct, and persuasive across technical and non-technical audiences","datePosted":"2026-08-17T11:55:37.893Z","dateModified":"2026-08-17T11:55:37.893Z","hiringOrganization":{"@type":"Organization","name":"Judgment Labs","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Millbrae","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"a624e60978f83dd096f12e66"},"url":"https://jobsearcher.com/jobs/a624e60978f83dd096f12e66"}}