Associate AI Engineer

About ETSETS is a global education and talent solutions organization enabling lifelong learners worldwide to be future-ready. For more than 75 years, we've been advancing the science of measurement to build benchmarks for fair and valid skill assessment across cultures and borders. Our worldwide impact extends through our renowned assessments including TOEFL, TOEIC, GRE and Praxis tests, serving millions of learners in more than 200 countries and territories. Through strategic acquisitions, we've expanded our global capabilities: PSI strengthens our workforce assessment solutions, while Edusoft, Kira Talent, Pipplet, Vericant, and Wheebox enhance our educational technology and assessment platforms across critical markets worldwide.Through ETS Research Institute and ETS Solutions, we're partnering with educational institutions, governments, and organizations globally to promote skill proficiency, empower upward mobility, and unlock opportunities for everyone, everywhere. With offices and partners across Asia, Europe, the Middle East, Africa, and the Americas, we deliver nearly 50 million tests annually. Join us in our journey of measuring progress to power human progress worldwide.The Associate AI Engineer contributes to the development of advanced, personalized adaptive learning technologies that power effective, efficient, and engaging educational experiences. As part of our AI product development team, you'll help build, evaluate, and maintain large-language-model (LLM) driven content generation, review, and quality-assurance systems that support large-scale educational assessments.Primary ResponsibilitiesAdhere to ethical standards and comply with the laws and regulations applicable to the job functionContributing to the development of AI-enabled services and workflows, including LLM-based content generation and review pipelines, to achieve objectives as outlined by Senior or Principal AI EngineersWork with data scientists to assist in building data ingest and data transformation infrastructuresProvide support to AI Engineers on the support assessment content, metadata, and evaluation pipelines during development, deployment, and recalibrationProvide support to evaluate, benchmark, and monitor AI and LLM system behavior and provide metrics to document and track their performance.Explore the data and help to identify differences in data distribution that could impact performance when deployed in prototypesUtilize best practices around the support for the design, coding, automated unit, regression testing, and deployment of AI-enabled services and LLM-based workflows to productionKeep current of latest AI research and applied advances in large-language-model platforms, orchestration tools, and evaluation methods relevant to educational assessment and content developmentUtilize best practices in the responsible use of AIWork closely with learning scientists and data scientists to define collection events and data transformations needed to drive personalized learning and to support assessment content development and review workflowsWork closely with Product Owners to understand potential and limitations of AI and LLM-based systems in the productWork effectively in the agile-at-scale frameworkClearly communicate findings, implementation details, and system behavior to senior AI engineers, product owners, and assessment domain expertsKnowledge/SkillsSome experience with Python-based software and data engineering frameworks and libraries, Java, and/or RSome experience with APIs and services for large-language models and related tooling (for example, model APIs, prompt-driven workflows, or orchestration platforms such as Dify or similar tools)Knowledge of statistical analysis and mathematical modeling concepts and principlesFamiliarity with JSON-based APIs, data pipelines, and cloud-based services used to integrate AI capabilities into production systemsExcellent communication skillsAbility to work effectively in a cross-functional teamEducation And ExperienceA Master's Degree in Computer Science, Applied Mathematics, Engineering or a related field1+ year of training or experience in software engineering, data engineering, or applied AI system development (including LLM-based systems)Some experience with Python-based software and data engineering frameworks, Java, and/or RSome experience with large-language-model platforms, APIs, and workflow orchestration toolsKnowledge of statistical analysis and mathematical modeling concepts and principlesExcellent communication skillsAbility to work effectively in a cross-functional teamInterest in educational assessment, learning science, or standardized testing environments, and in building human-in-the-loop AI systems for content development and reviewETS is mission driven and action orientedWe are passionate about hiring innovative thinkers who believe in the promise of education and lifelong learning.We are energized by cultivating growth, innovation, and continuous transformation for the next generation of rising professionals as leaders. In support of this ETS offers multiple Business Resource Groups (BRG) for you to learn and advance your career growth!As a not-for-profit organization we will encourage you to lean in to your passion for volunteering. At ETS you may qualify for up to an additional 8 hours of PTO for volunteer work on causes that are important to you!The base salary range advertised represents the low and high end of the anticipated salary range for this position. The base pay actually offered will take into account internal equity and also may vary depending on the candidate's geographic region, job-related knowledge, skills, and experience among other factors. The base pay is only one aspect of the Total Rewards Package that will be offered to the successful candidate.ETS is an Equal Opportunity Employer. We are committed to providing equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, marital status, veteran status, sexual orientation, gender identity, or any other characteristic protected by law. We believe in creating a work environment where all individuals are treated with respect and dignity.J-18808-Ljbffr