<Back to Search
Senior Backend Engineer, LangSmith Deployments
East Boston, MAApril 5th, 2026
About UsAt LangChain, our mission is to make intelligent agents ubiquitous. We build the foundation for agent engineering in the real world, helping developers move from prototypes to production-ready AI agents that teams can rely on. We began as widely adopted open-source tools and have grown to also offer a platform for building, evaluating, deploying, and operating agents at scale. Today, LangChain, LangGraph, LangSmith, and Fleet are used by teams shipping real AI products across startups and large enterprises. Millions of developers trust LangChain to power AI teams at companies like Replit, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, and 35% of the Fortune 500. With $125 M raised at Series B from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we're at a stage where we're continuing to develop new products, growth is accelerating, and all team members have meaningful impact on what we build and how we work together. LangChain is a place where your contributions can shape how this technology shows up in the real world.About the TeamThe Deployment team builds the platform that runs AI agents in production. We design and scale the core durable execution runtime to power reliable long-running agents with resumable streaming and inter-agent protocol support. We work closely with open-source and other product teams to make it easy to bring any agent from prototype to production.About the roleWe're building purpose-built infrastructure for running AI agents. Unlike traditional web apps, agents run for long durations, collaborate asynchronously with humans and other agents, and need to survive failures mid-execution. LangSmith Deployments is the runtime that makes this work, with durable checkpointing, fault-tolerant orchestration, and horizontal scaling, deployed across cloud and self-hosted environments.What You'll DoDesign distributed queue and worker systems that handle concurrent agent execution, background tasks, and multi-agent coordination across horizontally scalable infrastructureOwn core data infrastructure — state persistence, atomic job claiming, connection management, and schema evolutionCollaborate on architectural decisions, ensuring solutions are scalable and robust.Ship resumable streaming infrastructure so clients can disconnect and reconnect mid-execution without losing stateInstrument and monitor production systems — tracing, metrics, and alerting to keep the platform healthyParticipate in on-call rotations and own incident response for the runtimeCreate and maintain technical documentation, including system design and operational runbooks.Contribute to and extend open-source LangGraph, which is used by thousands of developers to build agent applicationsWhat You'll Bring4+ years of professional backend engineering experienceStrong proficiency in Go and/or PythonExperience with distributed systems - consensus mechanisms, queueing, state machines, and/or workflow orchestrationExperience with scaling and sharding databases in high-throughput environmentsFamiliarity with Kubernetes, infrastructure-as-code, and at least one major cloud platformStrong communication skills and ability to work cross-functionally on a small teamCompensation & BenefitsWe offer competitive compensation that includes base salary, meaningful equity, and benefits such as health and dental coverage, flexible vacation, a 401(k) plan, and life insurance. Actual compensation will vary based on role, level, and location. For team members in the EU and UK, we provide locally competitive benefits aligned with regional norms and regulations.Annual salary range: $175,000-$225,000 USDJ-18808-Ljbffr
609 matching similar jobs near East Boston, MA
- Distributed ML Engineer: vLLM & Kubernetes Inference
- Senior SDE, Alexa Multimodal Initiatives
- Healthcare Platform Integration Architect (MIRA)
- AI Solution Architect
- BCG Platinion | Senior IT Architect - Payments Technology
- Principal Architect, Core Platform
- Generative AI Solutions Architect
- Software Engineer - TID (Contractor Position)
- Senior ML Inference Engineer — LLM Optimization
- BCG Platinion | Senior IT Architect
- Deal Leader - Data and AI AP
- Research Scientist AI/ML Foundational Models - Pioneering Next-Gen Therapeutic Discoveries (BOSTON)
- Machine Learning Researcher for Foundational Models (BOSTON)
- Artificial Intelligence Scientist - Foundation Models (BOSTON)
- Senior Associate, R&D Tax Credits - Software Engineer
- Launchpad Software Developer - Paid Training + Relocation
- ML Co-op: AI Chatbots & LLMs for FinTech
- Hybrid Cloud Platform Engineer - AI & DevOps
- Java Engineer. Boston. Investment Bank. $120,000 - 140,000 + Bonus and Benefits. 5 Days a week in of
- Senior Software Engineer
- Senior Embedded Engineer
- AI Data Engineer 2
- Senior Software Engineer
- AI/ML Engineer
- Full Stack Developer Lead
- Python full stack engineer with AI and Angular
- AI/ML Engineer
- Software Dev Engineer III - AMZ9673940
- Senior Principal Software Engineer, Modeling & Simulation
- Digital Workplace Experience Solutions Architect
- Healthcare Solutions Architect
- Real-Time BEV Scene Understanding ML Engineer
- Principal AI-Machine Learning Engineer
- CTO: AI-Powered Marketplace Platform Leader (Remote)
- Principal ML Engineer: Open-Source LLM Inference
- Data Architect: Semantic Layer & AI Governance
- Software Architect
- AI-Driven Software Engineering Manager: Lead Scalable SaaS
- Hybrid Data Architect: Cloud, Governance & Analytics
- Cloud-Scale Software Architect - AI & Healthcare Automation