{"schemaVersion":"jobsearcher.job.v1","id":"b2d11f1511eeff8ef5182ea1","url":"https://jobsearcher.com/jobs/b2d11f1511eeff8ef5182ea1","canonicalUrl":"https://jobsearcher.com/jobs/b2d11f1511eeff8ef5182ea1","title":"AI Architect","description":"We are working with a pioneering technology company that is at the forefront of designing and scaling enterprise-grade AI solutions across diverse environments. This organization is dedicated to building innovative platforms that integrate cutting-edge AI with robust cloud infrastructure.The Role Design, govern, and scale enterprise-grade agentic AI solutions across hybrid and multi-cloud environments. Architect and implement an AI Gateway layer to unify access to multiple LLM/model providers with centralized routing, rate limiting, load balancing, caching, and failover. Define reference architectures for hybrid cloud AI deployments, balancing workloads across on-prem, private cloud, and public cloud based on data residency, latency, cost, and compliance requirements. Establish patterns for model orchestration, agent-to-agent communication, and tool/function calling across distributed systems. Own the strategy and implementation of the AI Gateway as the control plane for all AI/LLM traffic including authentication, authorization, usage metering, cost governance, PII/data redaction, prompt/response logging, and audit trails. Provide technical leadership and mentorship to AI/ML engineers and platform teams.What You'll Need 8+ years of experience in software/solutions architecture, with 3+ years focused on AI/ML systems. Proven hands-on experience architecting agentic AI systems (multi-agent frameworks, autonomous workflows, tool/function calling, and orchestration). Strong expertise in hybrid and multi-cloud architecture (AWS, Azure, Google Cloud Platform, and on-premises/private cloud integration). Demonstrated experience designing or implementing an AI Gateway / LLM Gateway (e.g., Kong, custom-built gateways) for managing multi-model access, routing, rate limiting, and observability. Deep understanding of LLM ecosystems (OpenAI, Anthropic, open-source models) and model serving infrastructure. Programming proficiency in Python.What's On Offer Opportunity to design and implement cutting-edge AI solutions. Work with hybrid and multi-cloud environments. Leadership and mentorship opportunities within a dynamic team.Apply via Haystack today!","company":"Haystack","rawCompany":"haystack","city":"Denver","state":"CO","isRemote":false,"isActive":false,"createdAt":"2026-09-02T07:49:49.953Z","occupations":[{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"AI Architect","description":"We are working with a pioneering technology company that is at the forefront of designing and scaling enterprise-grade AI solutions across diverse environments. This organization is dedicated to building innovative platforms that integrate cutting-edge AI with robust cloud infrastructure.The Role Design, govern, and scale enterprise-grade agentic AI solutions across hybrid and multi-cloud environments. Architect and implement an AI Gateway layer to unify access to multiple LLM/model providers with centralized routing, rate limiting, load balancing, caching, and failover. Define reference architectures for hybrid cloud AI deployments, balancing workloads across on-prem, private cloud, and public cloud based on data residency, latency, cost, and compliance requirements. Establish patterns for model orchestration, agent-to-agent communication, and tool/function calling across distributed systems. Own the strategy and implementation of the AI Gateway as the control plane for all AI/LLM traffic including authentication, authorization, usage metering, cost governance, PII/data redaction, prompt/response logging, and audit trails. Provide technical leadership and mentorship to AI/ML engineers and platform teams.What You'll Need 8+ years of experience in software/solutions architecture, with 3+ years focused on AI/ML systems. Proven hands-on experience architecting agentic AI systems (multi-agent frameworks, autonomous workflows, tool/function calling, and orchestration). Strong expertise in hybrid and multi-cloud architecture (AWS, Azure, Google Cloud Platform, and on-premises/private cloud integration). Demonstrated experience designing or implementing an AI Gateway / LLM Gateway (e.g., Kong, custom-built gateways) for managing multi-model access, routing, rate limiting, and observability. Deep understanding of LLM ecosystems (OpenAI, Anthropic, open-source models) and model serving infrastructure. Programming proficiency in Python.What's On Offer Opportunity to design and implement cutting-edge AI solutions. Work with hybrid and multi-cloud environments. Leadership and mentorship opportunities within a dynamic team.Apply via Haystack today!","datePosted":"2026-09-02T07:49:49.953Z","dateModified":"2026-09-02T07:49:49.953Z","hiringOrganization":{"@type":"Organization","name":"Haystack","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Denver","addressRegion":"CO","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"b2d11f1511eeff8ef5182ea1"},"url":"https://jobsearcher.com/jobs/b2d11f1511eeff8ef5182ea1"}}