Applications of ML Engineering Manager

Apple Services Engineering (ASE) powers many AI features across App Store, Music, Video and more. We build deeply personal products with the goal of representing users around the globe authentically. We work continuously to avoid perpetuating systemic biases and maintain safe and trustworthy experiences across our AI tools and models. We are hiring a Manager in Responsible Development u0026 Safety, to shape policies and model and application evaluation processes, to ensure safe and responsible deployment of Apple Services' user-facing features. You will build guidelines for internal engineering, human evaluation, and safety research teams, identify risks and contribute to mitigation strategies for new product features and functions.The role involves collaborating with engineering, research, and product teams to assess and measure the impact of ASE features. Your role involves ensuring safety best practices, reviewing AI model performance, and providing guidance. You'll use your expertise in technology's societal implications to improve the safety development ecosystem as a manager of a small team developing and conducting safety evaluations.A strong understanding of the challenges and issues in the fields of Responsible AI and/or Safety, through AI and society experience (e.g. relevant governance, policy, legal or research). Experience working directly with LLMs, LMMs, and generative AI and agentic systems, in a development and/or evaluation capacity. Experience leading new teams working on innovative initiatives within a well-established organization. 5+ years experiences with AI evaluations, managed with a diverse sets of collaborators, such as Product, Engineering, Security, and Legal teams. Experience navigating and assessing complex societal questions related to technology development, including balancing the benefits and risks of research and applications. Strong management skills, including the ability to communicate effectively in tight turnaround times. Excellent experience collaborating with technical stakeholders and highly interdisciplinary teams. Strong communication skills, both written and verbal. Technical Skills: Proficiency in Python for data analysis (pandas, NumPy, Jupyter, etc.). Experience working with large datasets, annotation tools, or model-evaluation pipelines. Ability to design taxonomies, categorization schemes, or structured rating frameworks. Communication: Strong ability to stitch together qualitative and quantitative findings into actionable guidance.Ph.D., J.D. or equivalent experience in Computer Science, Machine Learning, and/or Human-Computer Interaction 5+ years proven experience with AI product and/or user policies in multiple regions of the world