Senior AI Orchestration Engineer_Remote work
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Senior AI Orchestration EngineerLocation: Remote workDuration: 12 Months+We are looking for engineers to design and build an enterprise-grade AI orchestration layer that routes user requests across multiple AI agents and systems (e.g., Glean, Vertex AI, internal services) in a deterministic, governed, and scalable way. This is not traditional workflow orchestration. it is a control-plane driven AI routing system.Responsibilities:Develop and maintain adapter-based microservices that integrate with external and internal systems (e.g., Glean, Serval, Vertex AI, enterprise APIs), including transforming payloads, handling authentication (OAuth2/token-based), normalizing responses into a standard contract, and ensuring resiliency through error handling and retries.Establish and enforce standardized data contracts and response schemas across all services, ensuring consistency in outputs (e.g., answer, structured results, confidence, source) and enabling a unified experience for downstream consumers and UI layers.Build and evolve a distributed, microservices-driven architecture with well-defined service boundaries, enabling independent deployment, scalability, and extensibility of orchestration, adapter, and supporting services.Example: Event logging and telemetry pipeline using event-driven patterns (e.g., Pub/Sub), capturing request metadata, routing decisions, and agent responses, and persisting high-volume data into NoSQL/analytical stores (e.g., BigQuery) for reporting, monitoring, and auditability.Model and manage data using NoSQL paradigms, optimizing for high-throughput ingestion, flexible schema evolution (to support variable AI responses), and efficient querying for operational insights and executive reporting.