AI Architect

We are working with a pioneering technology company that is at the forefront of designing and scaling enterprise-grade AI solutions across diverse environments. This organization is dedicated to building innovative platforms that integrate cutting-edge AI with robust cloud infrastructure.The Role Design, govern, and scale enterprise-grade agentic AI solutions across hybrid and multi-cloud environments. Architect and implement an AI Gateway layer to unify access to multiple LLM/model providers with centralized routing, rate limiting, load balancing, caching, and failover. Define reference architectures for hybrid cloud AI deployments, balancing workloads across on-prem, private cloud, and public cloud based on data residency, latency, cost, and compliance requirements. Establish patterns for model orchestration, agent-to-agent communication, and tool/function calling across distributed systems. Own the strategy and implementation of the AI Gateway as the control plane for all AI/LLM traffic including authentication, authorization, usage metering, cost governance, PII/data redaction, prompt/response logging, and audit trails. Provide technical leadership and mentorship to AI/ML engineers and platform teams.What You'll Need 8+ years of experience in software/solutions architecture, with 3+ years focused on AI/ML systems. Proven hands-on experience architecting agentic AI systems (multi-agent frameworks, autonomous workflows, tool/function calling, and orchestration). Strong expertise in hybrid and multi-cloud architecture (AWS, Azure, Google Cloud Platform, and on-premises/private cloud integration). Demonstrated experience designing or implementing an AI Gateway / LLM Gateway (e.g., Kong, custom-built gateways) for managing multi-model access, routing, rate limiting, and observability. Deep understanding of LLM ecosystems (OpenAI, Anthropic, open-source models) and model serving infrastructure. Programming proficiency in Python.What's On Offer Opportunity to design and implement cutting-edge AI solutions. Work with hybrid and multi-cloud environments. Leadership and mentorship opportunities within a dynamic team.Apply via Haystack today!