Research Engineer - MSL FAIR Foundations

Meta is seeking Research Engineers to join the Evaluations team within Meta Superintelligence Labs. Evaluations are the core of AI progress at MSL, determining what capabilities get built, which features get prioritized, and how fast our models improve. As a Research Engineer on this team, you will curate and build the benchmarks for our most advanced AI models, across text, vision, audio, and beyond. You'll work alongside world-class researchers and engineers to collect, develop, and deploy novel benchmarks and reinforcement learning environments. This is a highly technical role requiring practical research engineering skills and the ability to work independently on a variety of open-ended machine learning challenges with high reliability. The evaluations you build will directly impact the research direction and major model lines within MSL, making engineering reliability, rigor, and scalability paramount. You will excel by maintaining high velocity while adapting to rapidly shifting priorities as we advance the technical research frontier. You'll need to be flexible and adaptive, tackling a wide variety of problems in the evaluations space, from implementing existing benchmarks to developing novel benchmarks and environments to implementing evaluation tooling at scale. If you are passionate about defining the capabilities that drive AI progress and thrive in fast-paced, high-impact research environments, we encourage you to apply for this exciting opportunity at the core of MSL.Minimum QualificationsBachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience4+ years of experience in machine learning engineering, machine learning research, or a related technical roleProficiency in Python and experience with ML frameworks such as PyTorchExperience identifying, designing and completing medium to large technical features independently, without guidanceDemonstrated experience in software engineering practices including version control, testing, and code review practicesAbility to work independently and adapt to rapidly changing prioritiesPreferred QualificationsPublications at peer-reviewed venues (NeurIPS, ICML, ICLR, ACL, EMNLP, or similar) related to language model evaluation, benchmarking, or deep learningHands-on experience with language model post-training and deep learning systems, or building reinforcement learning environmentsExperience implementing or developing evaluation benchmarks for large language models and multimodal models (e.g., vision-language, audio, video)Experience working with large-scale distributed systems and data pipelinesFamiliarity with language model evaluation frameworks and metricsTrack record of open-source contributions to ML evaluation tools or benchmarksResponsibilitiesCurate and integrate publicly available and internal benchmarks to direct the capabilities of frontier model developmentDevelop and implement evaluation environments, including environments for novel model capabilities and modalitiesCollaborate with external data vendors to source and prepare high-quality evaluation datasetsExecute on the technical vision of research scientists designing new benchmarks and evaluationsBuild robust, reusable evaluation pipelines that scale across multiple model lines and product areasContribute to evaluation tooling that measures the quality and reliability of evaluation suitesAbout MetaMeta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today-beyond the constraints of screens, the limits of distance, and even the rules of physics.Equal Employment OpportunityMeta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here.Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, fill out the Accommodations request form.