{"schemaVersion":"jobsearcher.job.v1","id":"af6bb3795a84ef002e528f06","url":"https://jobsearcher.com/jobs/af6bb3795a84ef002e528f06","canonicalUrl":"https://jobsearcher.com/jobs/af6bb3795a84ef002e528f06","title":"AI Engineer, Post-Training & Evaluation","description":"The roleOwn the models behind Coval’s judges. Coval is the evaluation platform for conversational AI: we help enterprise teams simulate, monitor and improve voice and chat agents before those agents ever reach a customer. Because our product is the judge, this role sits at the center of the company.You’ll own the model side end to end. You’ll design and ship the LLM-as-a-judge evaluations that score voice and chat conversations at scale, then sharpen them with LoRA fine-tunes on open-weight models and non-tuning work like tool use and context engineering. Your improvements ship directly into the product enterprises rely on to launch dependable voice agents.What You’ll DoDesign and ship the LLM judges that score conversations: rubrics, judge prompting, and calibration against human ratersBuild the reliability tracking that keeps judges honest from release to releaseRun post-training where training beats prompting: LoRA adapters on open-weight models, trained on data distilled from our own scored conversationsEverywhere else, do the non-tuning capability work: tool use, structured outputs, and context engineeringKeep asking which lever actually moves the metric, and focus thereWhat We’re Looking For4+ years as an engineer, with strong systems instinctsA track record of shipping measurable quality gains by pairing rigorous measurement with targeted training, not vibes and prompt tweaksYou’ve built eval infrastructure you actually trustYou’ve run LoRA/SFT experiments end to end, including preparing your own data rather than relying on clean data from other teams, so you know which lever really winsHigh agency: on a small Series A team, nobody hands you tickets. You figure out what matters next and drive it thereAmbitious and kind. You’ll be part of the group that founds our engineering org, sets its bar and grows the team","company":"Coval","rawCompany":"coval","city":"Millbrae","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-10-28T09:59:58.667Z","occupations":[{"code":"17-2199.00","title":"Engineers, All Other","slug":"engineers-all-other"},{"code":"17-2112.02","title":"Validation Engineers","slug":"validation-engineers"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"}],"industries":[{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541990","title":"All Other Professional, Scientific, and Technical Services","slug":"all-other-professional-scientific-and-technical-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"AI Engineer, Post-Training & Evaluation","description":"The roleOwn the models behind Coval’s judges. Coval is the evaluation platform for conversational AI: we help enterprise teams simulate, monitor and improve voice and chat agents before those agents ever reach a customer. Because our product is the judge, this role sits at the center of the company.You’ll own the model side end to end. You’ll design and ship the LLM-as-a-judge evaluations that score voice and chat conversations at scale, then sharpen them with LoRA fine-tunes on open-weight models and non-tuning work like tool use and context engineering. Your improvements ship directly into the product enterprises rely on to launch dependable voice agents.What You’ll DoDesign and ship the LLM judges that score conversations: rubrics, judge prompting, and calibration against human ratersBuild the reliability tracking that keeps judges honest from release to releaseRun post-training where training beats prompting: LoRA adapters on open-weight models, trained on data distilled from our own scored conversationsEverywhere else, do the non-tuning capability work: tool use, structured outputs, and context engineeringKeep asking which lever actually moves the metric, and focus thereWhat We’re Looking For4+ years as an engineer, with strong systems instinctsA track record of shipping measurable quality gains by pairing rigorous measurement with targeted training, not vibes and prompt tweaksYou’ve built eval infrastructure you actually trustYou’ve run LoRA/SFT experiments end to end, including preparing your own data rather than relying on clean data from other teams, so you know which lever really winsHigh agency: on a small Series A team, nobody hands you tickets. You figure out what matters next and drive it thereAmbitious and kind. You’ll be part of the group that founds our engineering org, sets its bar and grows the team","datePosted":"2026-10-28T09:59:58.667Z","dateModified":"2026-10-28T09:59:58.667Z","hiringOrganization":{"@type":"Organization","name":"Coval","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Millbrae","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"af6bb3795a84ef002e528f06"},"url":"https://jobsearcher.com/jobs/af6bb3795a84ef002e528f06"}}