Senior AI Engineer — Inference & Agent Systems - NY/SF

What our client is looking for:Our client is seeking a Senior AI Engineer with 3-7 years of experience who has a proven track record of building and shipping AI applications used daily by real, paying customers. You should be comfortable in a fast-paced startup environment and have a history of building production systems resilient to LLM non-determinism. Bonus points if you have experience in the finance domain.What you'll do:Drive inference optimization to get Time to First Token (TTFT) below 400ms for multi-step agent pipelines.Take ownership of our evaluation framework end-to-end, building ground truth datasets and automated scoring pipelines to detect regressions.Work closely with the CTO to design and implement Plan-Execute-Synthesize agent pipelines that run sub-agents in parallel.Integrate the latest state-of-the-art models (like Claude, GPT, Gemini) into our system and configure them for our analytics engine.Lead the development of reliable orchestration on top of Temporal, implementing retries, timeouts, and partial failure recovery.Build and maintain observability infrastructure to trace every token, tool call, and synthesis step.Seniority3 -​ 7 years of experience in AI/ML engineering shipping AI applications in production.​Work experienceWork Experience:Experience at an AI company that has seen scale with real,​ paying customers -​ Series A+ or demonstrated product market fit requiredExperience integrating LLMs (Claude,​ GPT,​ Gemini) into production applications;​ depth in at least 1-​2 of the following:​ inference optimization,​ agent architecture,​ or evals.​Finance or fintech experience (portfolio analytics,​ trading systems,​ or financial data applications,​ not HFT or pure quant engineering)EducationCS or closely related technical degreeHard skillsProficiency in Python for AI/ML development.​Experience with LLM orchestration frameworks and production AI infrastructure.​Experience with Go (Golang) is a plus.​Soft skillsStrong individual contributor (IC) focused on building.​MiscellaneousLocated in or willing to relocate to NY or SF -​ open to candidates in other Tier 1 tech hubs (e.​g.​,​ Seattle)Salary: $175K - $250K Equity: Competitive equityVisa sponsorship available : Open to sponsoring visas on a case-by-case basis.Hybrid work policy : This role is hybrid, based in our New York or San Francisco offices. NY/SF strongly preferred but willing to consider strong candidates for a remote position if based in Tier-1 cities (e.g., Seattle).