{"schemaVersion":"jobsearcher.job.v1","id":"b4c98ed17402e748202edb2d","url":"https://jobsearcher.com/jobs/b4c98ed17402e748202edb2d","canonicalUrl":"https://jobsearcher.com/jobs/b4c98ed17402e748202edb2d","title":"AI Engineer, Agent Analytics & Optimization","description":"Conviva Experience Analytics PlatformConviva is the experience analytics platform for AI agents, apps, and streaming. Conviva pioneered quality of experience measurement for streaming video and has supported live digital experiences across 20 Super Bowls, 10 Olympic Games, and five FIFA World Cup tournaments. With full-census, real-time, stateful analytics, Conviva shows what consumers actually experience, not just whether systems are running, and connects that experience to revenue, retention, and risk.The OpportunityAI agents are becoming a new digital surface alongside mobile and web. This role builds the systems that let AI agents understand, query, and act on Conviva's behavioral data — MCP servers, agentic workflows, and the AI connectors that tie the platform into any client or downstream system.This is a builder role end-to-end: design and ship agentic systems from tool interface through deployment, observability, and iteration — working closely with product and customers. This is not a research role, and it is not prompt engineering; the team builds production systems that use AI to solve real problems at scale.How This Role FitsThis is an engineering role, distinct from Conviva's Product Builder roles on the same team:Product Builders validate direction through customer discovery and prototypes — deciding what agent analytics should become.This role turns that direction into production-grade systems that run reliably at scale — owning the build and the runtime, not the roadmap.What Success Will Look Like:Build & ShipDesign and build MCP servers that expose Conviva's data and analytics as discoverable, reliable tools for AI agents, with proper auth, scoping, and access controlsArchitect and ship agentic workflows: multi-step reasoning, tool use, orchestration patterns, and human-in-the-loop where neededDevelop AI connectors integrating Conviva's intelligence with external agents, clients, and downstream systemsOwn the full lifecycle — API/tool design, deployment, monitoring, production hardeningReliability & IterationUse evals to validate agent behavior before shipping, catch regressions, and debug production divergenceBuild observability and tracing to make agent behavior inspectable and auditableTune for latency, cost, and reliability as models and data driftExecution & CollaborationPartner with Product Builders, design, and customers to ship working software (not prototypes)Build internal SDKs, reusable patterns, and shared context that raise the floor for the whole teamStay close to the fast-moving MCP/agent ecosystem and bring back what's relevantWho You Are and What You've Done:3–7+ years of software engineering experience, with production systems shipped end-to-endStrong Python backend fundamentals; comfortable owning services from design through deployment (fullstack a plus)Hands-on experience building and operating LLM-powered agents in production — with concrete stories of what broke, how you fixed it, and what you'd do differentlyPractical familiarity with agentic patterns: tool use, structured outputs, prompt chaining, multi-agent coordination, and knowing when a deterministic workflow is the right callExperience designing/building MCP servers or equivalent tool-use / AI connector integrationsHave used evals to validate and debug agent behaviorComfortable with cloud deployment (GCP/AWS), containerized services, and async PythonStrong product instinct — thinks about what users actually need and pushes back when a spec doesn't add upBonus PointsExperience with agentic frameworks (LangGraph, Anthropic SDK, Pydantic-AI, CrewAI, or similar)Agent observability/tracing (Langfuse, LangSmith, OpenTelemetry, or homegrown)Background in digital experience analytics, observability, or APMFamiliarity with agent evaluation or LLM-ops toolingPublished writing, talks, or open-source work at the intersection of engineering and AIWhat We OfferA front-row seat to a category being created in real time — agent analytics is where web analytics was in 2005A team that values builders — we use AI every day to move faster, not just talk about itA hybrid role shaping both the \"what\" and the \"how\" — strategy meets craftCompetitive compensation, equity, and benefitsThe expected salary range for this full-time position is $180,000–$250,000 + equity + benefits. Actual level and compensation are determined by qualifications, professional background, and relevant experience.","company":"Conviva","rawCompany":"conviva","city":"San Mateo","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-10-16T14:14:21.727Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"17-2199.00","title":"Engineers, All Other","slug":"engineers-all-other"}],"industries":[{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"AI Engineer, Agent Analytics & Optimization","description":"Conviva Experience Analytics PlatformConviva is the experience analytics platform for AI agents, apps, and streaming. Conviva pioneered quality of experience measurement for streaming video and has supported live digital experiences across 20 Super Bowls, 10 Olympic Games, and five FIFA World Cup tournaments. With full-census, real-time, stateful analytics, Conviva shows what consumers actually experience, not just whether systems are running, and connects that experience to revenue, retention, and risk.The OpportunityAI agents are becoming a new digital surface alongside mobile and web. This role builds the systems that let AI agents understand, query, and act on Conviva's behavioral data — MCP servers, agentic workflows, and the AI connectors that tie the platform into any client or downstream system.This is a builder role end-to-end: design and ship agentic systems from tool interface through deployment, observability, and iteration — working closely with product and customers. This is not a research role, and it is not prompt engineering; the team builds production systems that use AI to solve real problems at scale.How This Role FitsThis is an engineering role, distinct from Conviva's Product Builder roles on the same team:Product Builders validate direction through customer discovery and prototypes — deciding what agent analytics should become.This role turns that direction into production-grade systems that run reliably at scale — owning the build and the runtime, not the roadmap.What Success Will Look Like:Build & ShipDesign and build MCP servers that expose Conviva's data and analytics as discoverable, reliable tools for AI agents, with proper auth, scoping, and access controlsArchitect and ship agentic workflows: multi-step reasoning, tool use, orchestration patterns, and human-in-the-loop where neededDevelop AI connectors integrating Conviva's intelligence with external agents, clients, and downstream systemsOwn the full lifecycle — API/tool design, deployment, monitoring, production hardeningReliability & IterationUse evals to validate agent behavior before shipping, catch regressions, and debug production divergenceBuild observability and tracing to make agent behavior inspectable and auditableTune for latency, cost, and reliability as models and data driftExecution & CollaborationPartner with Product Builders, design, and customers to ship working software (not prototypes)Build internal SDKs, reusable patterns, and shared context that raise the floor for the whole teamStay close to the fast-moving MCP/agent ecosystem and bring back what's relevantWho You Are and What You've Done:3–7+ years of software engineering experience, with production systems shipped end-to-endStrong Python backend fundamentals; comfortable owning services from design through deployment (fullstack a plus)Hands-on experience building and operating LLM-powered agents in production — with concrete stories of what broke, how you fixed it, and what you'd do differentlyPractical familiarity with agentic patterns: tool use, structured outputs, prompt chaining, multi-agent coordination, and knowing when a deterministic workflow is the right callExperience designing/building MCP servers or equivalent tool-use / AI connector integrationsHave used evals to validate and debug agent behaviorComfortable with cloud deployment (GCP/AWS), containerized services, and async PythonStrong product instinct — thinks about what users actually need and pushes back when a spec doesn't add upBonus PointsExperience with agentic frameworks (LangGraph, Anthropic SDK, Pydantic-AI, CrewAI, or similar)Agent observability/tracing (Langfuse, LangSmith, OpenTelemetry, or homegrown)Background in digital experience analytics, observability, or APMFamiliarity with agent evaluation or LLM-ops toolingPublished writing, talks, or open-source work at the intersection of engineering and AIWhat We OfferA front-row seat to a category being created in real time — agent analytics is where web analytics was in 2005A team that values builders — we use AI every day to move faster, not just talk about itA hybrid role shaping both the \"what\" and the \"how\" — strategy meets craftCompetitive compensation, equity, and benefitsThe expected salary range for this full-time position is $180,000–$250,000 + equity + benefits. Actual level and compensation are determined by qualifications, professional background, and relevant experience.","datePosted":"2026-10-16T14:14:21.727Z","dateModified":"2026-10-16T14:14:21.727Z","hiringOrganization":{"@type":"Organization","name":"Conviva","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"San Mateo","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"b4c98ed17402e748202edb2d"},"url":"https://jobsearcher.com/jobs/b4c98ed17402e748202edb2d"}}