Model Behavior Architect- Safety
About MistralAt Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life.We democratize AI through high-performance, optimized, open-source and cutting-edge models, products and solutions. Our comprehensive AI platform is designed to meet enterprise as well as personal needs. Our offerings include Le Chat, La Plateforme, Mistral Code and Mistral Compute - a suite that brings frontier intelligence to end-users.We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between France, USA, UK, Germany and Singapore. We are creative, low-ego and team-spirited.Join us to be part of a pioneering company shaping the future of AI. Together, we can make a meaningful impact. See more about our culture on https://mistral.ai/careers.Mistral AI participates in the E-Verify programBy applying, you agree to our Applicant Privacy Policy.About the roleAs a Model Behavior Architect, you are at the forefront of defining and measuring LLM behaviour.We are looking for people who have built a career in engineering, machine learning, and large language models and are experts in model evaluation, policy writing, and creating eval pipelines for complicated tasks. Your role is to work hand-in-hand with our Science team to define what 'good' looks like for Reasoning, Audio, Alignment, Tools, and all Frontier bets.Join us if you are passionate about tackling cutting-edge, open-ended research challenges and transforming your insights into best-in-class models.What you will doInteract with models to identify where model behavior can be improvedGather internal and external feedback on model behavior to scope areas for improvementDesign and implement evals, data guidelines, data generation, and synthetic testing environmentsIdentify and fix edge case behaviors through rigorous testingDevelop robust evaluation pipelines for our model candidatesWork collaboratively with AI ScientistsAbout youYou have a deep understanding of either 1) linguistics, language, and translation, 2) engineering and code behavior, 3) LLM agents at work, including reasoning and tool useYou have prior knowledge in training and optimising model behaviourYou are an expert at building robust evaluationsYou thrive in dynamic and technically complex environmentsYou have a track record of delivering innovative, out-of-the-box solutions to address real-world constraintsBy applying, you agree to our Applicant Privacy Policy.