Senior Agentic (AI) Engineer

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that automate KYB, underwriting, and risk decisions on regulated financial data. You'll own agents end-to-end architecture, retrieval, tools, evals, and production deployment and partner closely with our Chief AI Officer, applied scientists, and platform teams.ResponsibilitiesDesign and ship multi-step agentic systems (planner/executor, tool-using, multi-agent, human-in-the-loop) for onboarding, underwriting, case review, and continuous monitoringArchitect agent graphs in LangGraph (or comparable — CrewAI, AutoGen, Claude Agent SDK) with explicit state, durable execution, retries, and safe fallbacksBuild the retrieval layer powering our agents — chunking, hybrid search, reranking, and grounded citationOwn the eval stack: golden sets, offline regression suites, LLM-as-judge, online A/B and shadow evals, and red-teaming for jailbreaks, prompt injection, and PII leakageExpose agents to production systems via well-typed tools and MCP servers. Treat tool surface area as a productDrive production MLOps: deployment, versioning, traffic shaping, cost/latency budgets, tracing, and on-call playbooks for agent incidentsPartner with security and compliance to keep agents inside SOC 2, GDPR, CCPA, and fair-lending posture — auditability and explainability built in, not bolted onMentor engineers on agent patterns, prompt hygiene, eval discipline, and LLM failure modesTechnology StackLanguages: Python, Node.js, TypeScriptAgent / LLM frameworks: LangGraph, LangChain, Claude Agent SDK, MCP, OpenAI SDKModels: Anthropic Claude, OpenAI, open-weight where appropriateRetrieval & Data: PostgreSQL, pgvector, OpenSearch, Kafka, Redshift, RedisInfra: AWS, Kubernetes (EKS), ArgoCD, TerraformEvals & Observability: LangSmith / Langfuse / Braintrust-style tooling, DataDogRequirements5+ years of software engineering experience, with 2+ years building production LLM or agentic systems (not just notebooks or demos)Hands-on experience with a modern agent framework (LangGraph strongly preferred) and a track record of shipping agents that run, fail gracefully, and recoverStrong RAG fundamentals chunking, embeddings, hybrid retrieval, reranking, grounding — and judgment about when RAG isn't the right answerReal eval experience golden sets, offline and online evaluations, used to make ship/no-ship callsProduction MLOps fluency: deployed LLM workloads under real latency, cost, and reliability constraintsStrong Python; comfortable in TypeScript / Node.jsSolid systems engineering instincts APIs, async patterns, queues, databases, distributed system failure modesCalibrated communicator; thrives in ambiguous, fast-moving environmentsPrior experience in fintech, lending, payments, KYB/KYC, fraud, or AMLExperience building MCP servers or other structured tool interfaces for LLMsBackground in classical ML (ranking, scoring, calibration)Experience designing explainable / auditable AI workflows for regulated environmentsOpen-source contributions to agent frameworks, eval tooling, or retrieval librariesAWS depth (EKS, MSK, RDS, S3, Lambda) and IaC with TerraformSuccess MetricsAgent Quality: Measurable improvements in task success rate, grounding accuracy, and hallucination rate on our eval suitesProduction Reliability: Agents you own meet defined SLOs for latency (P90/P99), tool-call success, and cost per taskVelocity: New agent capabilities go from prototype to production in weeks, without skipping evals or guardrailsRisk Posture: Zero material incidents tied to prompt injection, PII leakage, or unsafe tool use on agents you ownForce Multiplier: Patterns, tools, and eval scaffolding you build get adopted across engineeringAll Remote Hires will be required to travel to Orlando, Florida at least twice per year for Town Halls and team collaboration, in addition to orientation in Orlando.BenefitsHealth Care Plan (Medical, Dental & Vision)Retirement Plan (401k, IRA)Life Insurance Flexible Paid Time Off 9 paid Holidays Family Leave RemoteHybrid work (for Orlando Associates)Free Food & Snacks (Orlando)Wellness Resources