Senior AI Software Engineer (Architect of Autonomous Systems)

RTA is looking for a Senior AI Software Engineer who doesn't just use AI — you build the systems that run on their own. This role is for someone who thinks in agents, reasons in pipelines, and has a track record of shipping AI systems that actually work in production — not just in demos. You will report directly to the VP of Innovation and work closely with product and engineering leadership to design and deliver agentic AI features, self-improving systems, and intelligent automation that set RTA apart in the market.What You'll DoBuild Agentic AI SystemsDesign and ship multi-step AI agents that can reason, plan, and take action across Fleet360 data and workflowsBuild agent orchestration frameworks using patterns like ReAct, tool-calling, and multi-agent coordinationArchitect reliable agent pipelines with robust error handling, fallback strategies, and human-in-the-loop checkpoints where they matterUse orchestration frameworks (CrewAI, LangGraph, etc.) to build, manage, and scale Agentic AI systemsDesign agents that proactively surface insights and take autonomous action on behalf of fleet operatorsBuild Self-Improving SystemsDesign systems that observe their own outputs, measure quality over time, and automatically adjust based on production signalsBuild feedback loops that close themselves — where model behavior, agent decisions, and pipeline outputs feed back into improved performance without manual interventionImplement continuous evaluation pipelines that track model and system quality in production, detect degradation early, and trigger retraining or recalibration automaticallyDesign data flywheels that make every user interaction smarter — capturing signal, labeling at scale, and feeding it back into fine-tuning and prompt optimizationArchitect systems with self-assessment built in — agents that know when they're uncertain, recognize their limits, and route accordinglyFine-Tune and Adapt LLMsRun structured fine-tuning experiments on domain-specific datasets to improve model performance for fleet and maintenance use casesDesign and manage evaluation pipelines that measure model quality reliably before and after changesMake principled decisions about when to fine-tune, prompt-engineer, or adopt a different toolMaintain a clear-eyed view of model trade-offs — latency, cost, accuracy, hallucination risk — and make decisions accordinglyAutomate Your Own Work (and Ours)Bring a genuine AI-native approach to your daily workflow — using agents, scripts, and AI tools to reduce repetitive work and accelerate iterationBuild internal tooling and automation that helps product and engineering teams move fasterChampion a culture where AI is a standard part of the engineering toolkit, not an occasional experimentShare what you're learning so teammates get smarter about AICollaborate Across the OrganizationPartner with Product, Engineering, and Customer Success to identify high-value AI opportunities in Fleet360Translate fuzzy product goals into concrete AI system designs with honest assessments of feasibility and riskCommunicate clearly about what AI systems can and can't do, especially to non-technical stakeholdersContribute to RTA's broader AI roadmap and help shape how intelligence is woven into the platform over timeOur Technology StackOur AI engineering work spans a modern SaaS platform built on Node.js, TypeScript, Microsoft SQL Server, Elasticsearch, and Vue.js, with AI systems layered on top using LLMs via API (OpenAI, Anthropic, and others), vector databases, and agent frameworks.Required Qualifications5+ years of professional software engineering experience2+ years of hands-on experience building production AI/ML systems — not just prototypesDeep experience designing and shipping agentic AI systems using orchestration frameworks, tool-calling, and multi-step reasoning pipelinesProven experience fine-tuning LLMs on domain-specific data, including dataset preparation, training runs, and rigorous evaluationExperience building self-improving or self-monitoring systems that observe outputs, measure quality over time, and auto-adjustStrong software engineering fundamentals: clean code, system design, testing, and production reliabilityA genuine track record of using AI heavily in everyday workExperience with vector databases, embeddings, RAG pipelines, or semantic search in productionStrong communication skills and ability to work across engineering, product, and business stakeholdersWhat Makes Someone Successful in This RoleHas shipped agentic AI systems in production and can discuss failures and lessons learnedThinks about AI systems in terms of reliability, observability, and failure modes — not just accuracy metricsHas actually fine-tuned a model, evaluated its performance rigorously, and made principled decisions based on resultsUses AI so heavily in own work that switching back would be difficultBuilds things designed to run themselves and plans for what happens if they don'tCommunicates clearly and honestly about what AI can and can't do in a given contextThrives in an environment that rewards ownership, accountability, and continuous improvementIs curious enough to keep learning in a fast-moving field and has fundamentals to adapt quicklyBenefits$180,000 – $220,000 base salary, depending on experience401(k) + 6% Safe Harbor match (100% vested day one)Cigna PPO or HSA options with company contributions (up to $1,950/year)Garner Health (HRA): up to $1,000 individual / $2,000 familyWellness rewards up to $350/yearVirtual care + mental health supportLegal plans, ID theft, EAP, STD & LTD benefitsFlexible time off policyReasonable AccommodationRTA is committed to providing reasonable accommodations for qualified individuals with disabilities. If you need a reasonable accommodation to complete the application process or perform the essential functions of this role, please let us know.Equal Employment OpportunityRTA is an equal opportunity employer and does not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or any other protected status.RequirementsWe cannot accept any student visas or provide sponsorship at this time.J-18808-Ljbffr