Manager, Content Engineering — AI Content Understanding

Product Content Engineering is a horizontal function supporting initiatives across Meta's Family of Apps. We partner closely with product and technical teams to solve problems by providing content-centered solutions, setting standards of quality, and building the frameworks that ensure AI-powered experiences actually work for people.We're looking for a people manager to lead a team within PCE's AI Content Understanding group. This team is responsible for executing evaluations and improving the quality of Meta's content understanding models — the AI systems that understand what content is about and how it should be ranked, recommended, and moderated. The work spans content quality, AI evaluation, and the search and recommendation systems that power Meta's products — building the frameworks, rubrics, and pipelines that hold AI outputs to a high standard. Your team assesses model behavior, identifies where it falls short, and works cross-functionally with engineering, product, research, and data science teams to make it better. Reporting to the AI CU lead, you'll manage a team of Content Engineers and contingent workers, owning the day-to-day execution of human evaluations, golden dataset creation, auto-eval calibration, and cross-functional delivery with engineering, data science, and product partners. You'll drive operational rigor while navigating a fast-moving environment where evaluation frameworks, model capabilities, and team processes are evolving simultaneously.Manager, Content Engineering — AI Content Understanding Responsibilities:Manage and develop a team of Content Engineers and contingent workers, setting clear goals, providing regular feedback, and supporting career growthOwn the execution of continuous CU model evaluations — coordinating sprint planning, reviewer assignments, QA processes, and delivery timelines across multiple concurrent workstreamsDrive the creation and maintenance of golden datasets that serve as ground truth for model benchmarking and auto-eval calibrationPartner with engineering, data science, and product teams to translate evaluation insights into actionable recommendations for model improvement and prompt optimizationLead the team's contribution to LLM-as-a-Judge (auto-eval) initiatives — ensuring human evaluation data is used to calibrate, validate, and improve automated evaluation systemsDefine and maintain evaluation guidelines, rubrics, and quality standards in partnership with Lead Content Engineers, ensuring consistency across reviewers and use casesBuild repeatable operational processes for evaluation sprints, including reviewer training, calibration sessions, and escalation workflowsManage CW workforce planning — hiring, onboarding, allocation across workstreams, and performance managementSynthesize evaluation results into structured reports and present findings to cross-functional leadership, including engineering leads and lead product stakeholdersIdentify and mitigate operational risks — staffing gaps, timeline conflicts, quality regressions — before they impact deliveryIf you have a proven experience of proactively identifying, scoping and implementing innovative solutions, demonstrated success in identifying issues and improving processes, to create impact and bring demonstrated experience in content judgment to AI evaluation, we encourage you to applyMinimum Qualifications:8+ years of experience in content strategy, content operations, AI evaluation, or a related field2+ years of people management experience, including hiring, developing, and performance-managing direct reportsExperience managing cross-functional programs with engineering, data science, and product partners in fast-paced environments1+ years working with generative AI products, AI evaluation, prompt engineering, annotation, and/or content labeling and analysisExperience designing or operationalizing evaluation frameworks, annotation guidelines, or quality rubrics for AI/ML systemsDemonstrated ability to manage multiple concurrent workstreams with competing priorities and tight deadlinesProven analytical skills with experience interpreting evaluation data and communicating findings to technical and non-technical audiencesTrack record of building team operational processes and quality standards from the ground up or during periods of significant changePreferred Qualifications:Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologiesExperience managing contingent worker (CW) teams, vendor relationships, or scaled annotation operationsFamiliarity with AI evaluation methods such as human eval, LLM-as-judge, model benchmarking, A/B testing, or red-teamingExperience with Python, SQL, or other tools for data analysis and evaluation automationBackground in content understanding, search quality, recommendation systems, or trust and safetyExperience managing through organizational transitions, including shifts from manual to automated workflowsBA or BS in Computer Science, Data Science, Linguistics, or related fieldAbout Meta:Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@meta.com.$162,000/year to $227,000/year + bonus + equity + benefitsIndividual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.