Senior LLM/AI Platform Engineer

About PeratonPeraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world's leading mission capability integrator and transformative enterprise IT provider, we deliver trusted, highly differentiated solutions and technologies to protect our nation and allies. Peraton operates at the critical nexus between traditional and nontraditional threats across all domains: land, sea, space, air, and cyberspace. The company serves as a valued partner to essential government agencies and supports every branch of the U.S. armed forces. Each day, our employees solve the most daunting challenges that our customers face. Visit peraton.com to learn how we're keeping people around the world safe and secure.About The RolePeraton Labs is seeking a senior engineer to serve as the technical lead for the multi-agent generative AI orchestration layer that powers an advanced analytical platform. This role owns the architecture governing how multiple LLM-based worker agents are spawned, routed, coordinated, and managed across diverse analytical tasks. The Senior LLM/AI Platform Engineer ensures that the platform's generative AI backbone is reliable, performant, and extensible as new worker types and capabilities are introduced.Key ResponsibilitiesArchitect and maintain the multi-agent orchestration framework, including worker spawning, conversation history isolation, context management, and inter-worker coordinationDesign and implement token optimization strategies, including context window management, conversation summarization, and efficient prompt constructionOwn the model routing layer that directs tasks to appropriate model tiers based on task complexity and user configurationDevelop and refine prompt engineering patterns for worker agents to ensure consistent, high-quality analytical outputsEstablish evaluation frameworks to measure generative AI output quality, accuracy, and reliability across worker typesLead the design of new worker types to support program management capabilities (cost analysis workers, risk analysis workers, data fusion workers)Collaborate with PM Domain Analysts to translate program management requirements into generative AI agent behaviorsMentor junior LLM/AI Platform Engineers and establish engineering standards for generative AI developmentQualificationsRequired QualificationsMinimum of 8+ years of experience with a Bachelor's degree, 6+ years with a Master's degree, or 3+ years with a PhD in Computer Science, AI/ML, or related fieldDeep experience with large language model architectures, fine-tuning, and inference optimizationProficiency in Python; experience with LLM frameworks (LangChain, LlamaIndex, or equivalent)Strong understanding of prompt engineering, retrieval-augmented generation (RAG), and agent-based architecturesExperience with vector databases and embedding modelsDemonstrated ability to architect complex, multi-component generative AI systemsUS Citizenship with the ability to obtain/maintain a Secret clearancePreferred QualificationsExperience with multi-agent systems or autonomous agent frameworksFamiliarity with government/defense program management conceptsExperience with model evaluation and red-teaming methodologiesKnowledge of FedRAMP or DoD cloud security requirements7+ years of software engineering experience, with 3+ years focused on LLM/NLP systemsGraduate degree in Computer Science, AI/ML, or related field is highly desiredDetailsTarget Salary Range: $112,000 - $179,000. This represents the typical salary range for this position. Salary is determined by various factors, including but not limited to, the scope and responsibilities of the position, the individual's experience, education, knowledge, skills, and competencies, as well as geographic location and business and contract considerations. Depending on the position, employees may be eligible for overtime, shift differential, and a discretionary bonus in addition to base pay.Benefits Statement: Peraton offers eligible employees a variety of benefits including medical, dental, vision, life, health savings account, short/long term disability, EAP, parental leave, 401(k), paid time off (PTO) for vacation, and company paid holidays. A full listing of available benefits can be viewed at https://www.careers.peraton.com/benefits.Application Statements: The application period for the job is estimated to be 30 days from the job posting date. However, this timeline may be shortened or extended depending on business needs and the availability of qualified candidates. By applying to this job, you are expressing interest in the role and the Company. During the review of your application, you may be required to participate in an on-camera interview, as well as participate in a process to verify your identity.EEO:Equal opportunity employer, including disability and protected veterans, or other characteristics protected by law.