<Back to Search
Software AI Engineer - Agentic AI
New York, NYApril 2nd, 2026
Job Title : Software AI Engineer - Agentic AILocation : New York, NY (ONSITE)FTE ONLYJob Description• 10+ years of experience building large-scale distributed systems + strong experience with LLM systems, agentic workflows or advanced ML infrastructure• Proven ownership of complex, cross-cutting agentic systems spanning multiple teams or products.• Strong engineering fundamentals across backend systems, APIs, data pipelines, and cloud infrastructure.• Deep experience across the agentic AI stack, including planning, tool use, memory, and evaluation.• Fluency with AI-assisted and agentic development workflows.• Comfort operating in ambiguous problem spaces and translating them into shipped, reliable autonomous systems.• Ability to influence technical direction and align teams without formal authority.• Experience in workflow engines, async processing, queues, and streaming systems.• Languages: Python, Go, TypeScript• APIs and services: REST, gRPC• Cloud and infrastructure: AWS and/or GCP, Kubernetes• Distributed systems: event-driven architectures, including Kafka• Orchestration Frameworks: LangGraph, LangChain, AirFlow, etc• Integration of commercial and open-source LLMs into agentic workflows• Agent and orchestration frameworks such as LangChain, LlamaIndex, Semantic Kernel, or CrewAI, with strong judgment about when to use frameworks versus building lighter-weight primitives• Model-level work using PyTorch and the Hugging Face ecosystem (embeddings, fine-tuning, inference tooling), with some exposure to TensorFlow• Strong schema, validation, and state management practices using tools such as Pydantic (Python) and Zod (TypeScript)• Drive technical direction for agentic AI initiatives, influencing architecture patterns, autonomy boundaries, and system design.• Design, build, and operate production-grade agentic AI systems used across multiple products.• Own and evolve shared agentic AI capabilities, including:• Agent frameworks and orchestration layers• Planning, tool use, and memory strategies• Retrieval and grounding (RAG) pipelines• LLM infrastructure, inference, and model gateways• Evaluation, observability, and safety tooling for autonomous systems• Lead technical design reviews and help teams navigate tradeoffs involving autonomy, safety, reliability, scalability, and cost.• Partner across teams to deliver complex, cross-cutting agentic AI initiatives from concept to pro duction.• Evaluate emerging models, techniques, and agentic patterns and translate them into practical, enterprise-ready improvements.
1,780 matching similar jobs near New York, NY
- Staff Software Engineer
- Senior Software Engineer, AI
- Staff Software Engineer
- ML Engineer
- Principal Software Engineer (Python, KDB, Shell Scripting, Java)
- Principal Software Engineer (Python, KDB, Shell Scripting, Java)
- Sr. Software Engineer - AI/ML - AI Platform
- Senior Software Engineer - Analytics Registry & Notification
- Senior Lead AI Engineer (FM Hosting)
- Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)
- Senior Staff Software Engineer - Global Commercial Services - Agentic AI
- Agentic AI Engineer
- Senior Lead AI Engineer (GenAI Platform)
- Sr. Distinguished AI Engineer
- Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)
- Lead AI Engineer (FM Hosting, LLM Inference)
- Sr. Lead AI Engineer (MLX)
- Senior Lead AI Engineer
- Senior Distinguished AI Engineer
- Senior Lead AI Engineer (Remote-Eligible)Brooklyn, NYApril 1st, 2026
- Senior Lead AI Engineer (Gen AI Platform Services)
- Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI)
- Lead AI Engineer
- Lead AI Engineer (AI Foundations, LLM Customization and Finetuning)
- Lead AI Engineer (AI Foundations)
- Senior AI Engineer (Gen AI Platform Services, Agentic Systems)
- Distinguished AI Engineer
- Lead Machine Learning Engineer (Gen AI, Python, Go, AWS)
- Principal Software Engineer (Python, KDB, Shell Scripting, Java)
- Sr. Lead AI Engineer (AI Foundations)
- Senior Lead AI Engineer (LLM Customization and Finetuning)
- AI Engineer
- AI/ML Developer
- Python Software Engineer - Ai Training
- Senior Software Engineer, AI/ML, Search
- Founding Backend Engineer (AI Focus) - Atrix
- Go/Golang Developer - Ai Training
- Go/Golang Software Engineer - Ai Training
- Staff Software Engineer
- Software Engineer