Senior AI Engineer, Agentic Evaluation & V&V

Meet SlingshotAt Slingshot Aerospace,we'reon a mission to make space safer and more secure for everyone. Our work directlyimpactsglobal security, disaster response, climate monitoring, and the critical infrastructure that connects our world.We'rea team of builders, thinkers, and problem-solvers who believe that the next generation of space operations will be powered by better data and smarter software.WhatYou'llBe LaunchingAs a Senior AI Engineer focused on Agentic Evaluation and Verification and Validation (V&V), you will join the AI and Data Science team within Slingshot's Research and Development organization. You will contribute to advancing how intelligent systems are evaluated andvalidatedfor mission-critical space operations.This role focuses on building and scaling evaluation frameworks, benchmarks, and simulation-backed validation systems for agentic AI systems, including multi-step, tool-using, and autonomous decision-making workflows powered by LLMs and reinforcement learning. Your work will directly support the development of reliable and trustworthy autonomous mission planning systems.You will partner closely with AI researchers and domain experts to translate real-world mission concepts into structured, testable evaluation systems.Your Mission (Should you choose to accept it)Extend andmaintainSlingshot's V&V SDK and evaluation framework for simulation-backed validation of agentic AI systemsDesign and implement agent-level and end-to-end evaluations, including benchmark scenarios, scoring logic, and experiment harnessesBuild benchmark scenarios and tooling that measure planning, reasoning, and operational performance for autonomous mission planning systemsTranslate astrodynamics and mission-domain concepts into executable evaluation scenarios and simulation configurationsDevelop reusable SDK interfaces, adapters, and evaluation utilities that connect V&V systems, TALOS benchmarks, and agent workflowsDefine and apply metrics for capability evaluation, failure analysis, regression detection, and comparative benchmarkingPartner with cross-functional teams toidentifyevaluation needs and contribute to improving coverage of critical capabilitiesContribute to best practices for evaluating complex, autonomous AI systemsUphold strong engineering standards through testing, documentation, reproducibility, and maintainable system designPre-flight Checklist6+ years of experience in software engineering, machine learning engineering, applied AI, or equivalent experienceStrong Python engineering skills with experience building SDKs, libraries, or evaluation toolingExperience designing evaluation frameworks, benchmarks, metrics, or test harnesses for AI/ML systemsAbility to analyze system behavior,identifyfailure modes, and evaluate performance in complex autonomous or semi-autonomous systemsFamiliarity with modern agent frameworks, orchestration patterns, or protocol-based integrationsExperience working in cross-functional, multidisciplinary teamsStrong written and verbal communication skillsBachelor's degree in a relevant science or engineering field, or equivalent experienceMust be a U.S. citizen and eligible to obtain andmaintaina government security clearanceBonus CargoExperience in autonomous systems such as self-driving or ADAS, includingperception, planning, simulation, or safety validationExperience developing or evaluating agentic AI systems, including multi-step, tool-using, or autonomous workflows (e.g., LLM-based agents, planning agents, or reinforcement learning approaches)Experience with reinforcement learning systems and simulation-based evaluationFamiliarity with benchmark design, experiment tracking, and trace-based evaluation workflowsExperience with orchestration frameworks such asLangGraphor similar toolsKnowledge of astrodynamics, orbital mechanics, or spacecraft mission planningExperience translating mission or operational concepts into measurable evaluation scenariosFamiliarity with physics-based simulation, trajectory analysis, or space-domain modelingExperience with observability and experiment tooling such asMLflow, Opik, or similar platformsExperience transitioning advanced research systems into production environmentsWe'rebuilding a constellation here, not looking for identical satellites. Every member of the team brings different capabilities to the same mission. If your orbit intersects with ours andyou'remission-ready, send it.Location: Remote, USSalary: $150,000-$250,000Classification: Full time Exempt (learned professional exemption)US-based Candidates: we are currently only able to hire residents of the following U.S. states: AL, AZ, CA, CO, DC, FL, GA, HI, IL, IN, KS, MA, MD, MI, MN, MO, MT, NC, NJ, NM, NV, NY, OH, OK, OR, RI, TN, TX, UT, VA, WA, WI, WV We are unable to consider candidates residing in other U.S. states at this time.Internationally-based Candidates: we are currently only able to hire residents of the following locations: United Kingdom. We are unable to consider candidates residing in other countries at this time.Equity, Diversity & Inclusion are key to our success. We are an Equal Opportunity Employer and our employees are people with different strengths, experiences, and backgrounds, who share a passion for creating a safer, more connected world. Diversity not only includes race and gender identity, but also national origin, citizenship, sex, color, veteran status, disability, genetic information, or any other protected characteristic that is part of one's identity. All of our employees' points of view are key to our success, and we embrace individuality.