{"schemaVersion":"jobsearcher.job.v1","id":"f6828889bb46a7ff33a0047a","url":"https://jobsearcher.com/jobs/f6828889bb46a7ff33a0047a","canonicalUrl":"https://jobsearcher.com/jobs/f6828889bb46a7ff33a0047a","title":"Sr. Machine Learning Engineer, ML Systems Evaluation Engineering","description":"Join the team redefining what a deeply personal and integrated assistant can be. As part of the Siri organization, you will help shape one of the world's most widely used AI assistants, powered by our next-generation of Apple Intelligence, with capabilities like personal context understanding and on-screen awareness, built with privacy from the ground up. Your work will have direct, meaningful impact for users across iOS, iPadOS, macOS, watchOS, and visionOS. This is a rare opportunity to build at the intersection of cutting-edge AI and human-centered design, shipping technology that is centered around users and their needs. Join the SCALE (Statistical Coverage and Large-scale Evaluation) team at Apple and contribute to a highly accomplished group that evaluates Siri and AI/ML models at scale to delight and inspire our users globally. If you are excited by large-scale systems, rigorous statistical evaluation, natural language understanding, and shaping the future of AI, we want you here! You’ll do more than join something, you’ll add something!\r\nDescription\r\nWe are seeking a highly skilled Senior Machine Learning Engineer specializing in Conversational AI. Our goal is to deliver offline evaluation insights that drive model development and improve the end-user experience, all while upholding Apple's strict privacy standards. In this pivotal role, you will collaborate with cross-functional teams to curate and evolve high-quality evaluation datasets for state-of-the-art models. With the advent of Apple Intelligence, you will tackle novel challenges in evaluating highly personalized user experiences.\r\nMinimum Qualifications7+ years of professional experience applying machine learning to real-world problems and crafting scalable data solutions, specifically in natural language products.\r\nProven experience managing large-scale datasets for ML training and/or evaluation.\r\nExcellent programming skills in PythonMS/PhD in Machine Learning, Computer Science, or equivalent experience in a related fieldPreferred Qualifications\r\nThe qualifications that will benefit a candidate to be successful in your role. Please list no more than 6-8.Deep domain knowledge in Conversational AI and a strong understanding of the end-to-end ML product lifecycle.\r\nExpertise in defining and measuring evaluation coverage for Large Language Models (LLMs) and agentic systems.\r\nTrack record of delivering large-scale, cross-functional ML product or platform outcomes.\r\nExcellent problem-solving, critical thinking, and communication skills to drive alignment across teams.\r\nExperience with systems engineering; in-depth understanding of interdependencies of ML and SW components#J-18808-Ljbffr","company":"Socket","rawCompany":"socket","city":"Cupertino","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-09-23T01:26:02.723Z","occupations":[{"code":"15-1221.00","title":"Computer and Information Research Scientists","slug":"computer-and-information-research-scientists"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Sr. Machine Learning Engineer, ML Systems Evaluation Engineering","description":"Join the team redefining what a deeply personal and integrated assistant can be. As part of the Siri organization, you will help shape one of the world's most widely used AI assistants, powered by our next-generation of Apple Intelligence, with capabilities like personal context understanding and on-screen awareness, built with privacy from the ground up. Your work will have direct, meaningful impact for users across iOS, iPadOS, macOS, watchOS, and visionOS. This is a rare opportunity to build at the intersection of cutting-edge AI and human-centered design, shipping technology that is centered around users and their needs. Join the SCALE (Statistical Coverage and Large-scale Evaluation) team at Apple and contribute to a highly accomplished group that evaluates Siri and AI/ML models at scale to delight and inspire our users globally. If you are excited by large-scale systems, rigorous statistical evaluation, natural language understanding, and shaping the future of AI, we want you here! You’ll do more than join something, you’ll add something!\r\nDescription\r\nWe are seeking a highly skilled Senior Machine Learning Engineer specializing in Conversational AI. Our goal is to deliver offline evaluation insights that drive model development and improve the end-user experience, all while upholding Apple's strict privacy standards. In this pivotal role, you will collaborate with cross-functional teams to curate and evolve high-quality evaluation datasets for state-of-the-art models. With the advent of Apple Intelligence, you will tackle novel challenges in evaluating highly personalized user experiences.\r\nMinimum Qualifications7+ years of professional experience applying machine learning to real-world problems and crafting scalable data solutions, specifically in natural language products.\r\nProven experience managing large-scale datasets for ML training and/or evaluation.\r\nExcellent programming skills in PythonMS/PhD in Machine Learning, Computer Science, or equivalent experience in a related fieldPreferred Qualifications\r\nThe qualifications that will benefit a candidate to be successful in your role. Please list no more than 6-8.Deep domain knowledge in Conversational AI and a strong understanding of the end-to-end ML product lifecycle.\r\nExpertise in defining and measuring evaluation coverage for Large Language Models (LLMs) and agentic systems.\r\nTrack record of delivering large-scale, cross-functional ML product or platform outcomes.\r\nExcellent problem-solving, critical thinking, and communication skills to drive alignment across teams.\r\nExperience with systems engineering; in-depth understanding of interdependencies of ML and SW components#J-18808-Ljbffr","datePosted":"2026-09-23T01:26:02.723Z","dateModified":"2026-09-23T01:26:02.723Z","hiringOrganization":{"@type":"Organization","name":"Socket","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Cupertino","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"f6828889bb46a7ff33a0047a"},"url":"https://jobsearcher.com/jobs/f6828889bb46a7ff33a0047a"}}