{"schemaVersion":"jobsearcher.job.v1","id":"2e5afa4755254e25aa8a25bf","url":"https://jobsearcher.com/jobs/2e5afa4755254e25aa8a25bf","canonicalUrl":"https://jobsearcher.com/jobs/2e5afa4755254e25aa8a25bf","title":"Platform Engineer (AI/LLM Infrastructure)","description":"Role: Platform Engineer (AI/LLM Infrastructure)Location: Santa Clara, CA (3 days onsite in a week)Day to Day Job Duties:Lead the design, implementation, and operation of scalable infrastructure platforms supporting AI/LLM-based solutions for enterprise clientsAct as a hands-on technical lead (player-coach), contributing to development while guiding a team of engineersOwn end-to-end infrastructure architecture below the application layer, including compute, container orchestration, CI/CD, observability, and securityPartner directly with clients and stakeholders to design, present, and deliver robust AI infrastructure solutionsArchitect and manage production-grade Kubernetes environments (AKS/EKS), including cluster operations and RBACDesign and operationalize RAG pipelines, including ingestion, chunking, embedding workflows, and vector database managementLead GPU infrastructure provisioning and optimization (NVIDIA A100/H100 or similar)Drive Infrastructure-as-Code adoption using Terraform and GitOps practices (ArgoCD/Flux)Build and maintain CI/CD pipelines using GitHub Actions and Azure DevOpsEstablish observability standards using Datadog, OpenTelemetry, and ELK/OpenSearchLead incident response, on-call processes, and post-mortem analysisEnsure strong security posture and lead InfoSec review processesCoordinate delivery across multiple teams and client engagementsBasic Qualifications:5–8 years of experience in Platform Engineering, SRE, or Infrastructure Engineering3+ years of Proven experience delivering and leading infrastructure for AI/LLM-based production systemsStrong hands-on expertise in Kubernetes, Docker, Helm3+ years of experience with Terraform and GitOps (ArgoCD/Flux)3+ years of experience with Azure (Key Vault, Monitor, DevOps Pipelines)3+ years of experience leading client-facing technical engagements3+ years of experience managing multiple concurrent projects or teams3+ years of Hands-on experience with incident management and SLA-driven environments3+ years of Experience leading security/InfoSec reviewsStrong understanding of vector databases, RAG pipelines, and LLM inference systems3+ years of Experience with CI/CD and container registry managementDegree:Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience.Nice to Have (But Not Required):Experience with AWS in addition to AzureFamiliarity with Azure API Management and AKSExperience with Pulumi (Python/TypeScript)Knowledge of NIM deployment and lifecycle managementPython scripting for infrastructure automationExperience with load testing tools (k6, Locust, JMeter)Exposure to FinOps and cost optimization practices","company":"Technogen","rawCompany":"technogen","city":"San Jose","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-05-20T18:22:00.934Z","occupations":[{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1211.00","title":"Computer Systems Analysts","slug":"computer-systems-analysts"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Platform Engineer (AI/LLM Infrastructure)","description":"Role: Platform Engineer (AI/LLM Infrastructure)Location: Santa Clara, CA (3 days onsite in a week)Day to Day Job Duties:Lead the design, implementation, and operation of scalable infrastructure platforms supporting AI/LLM-based solutions for enterprise clientsAct as a hands-on technical lead (player-coach), contributing to development while guiding a team of engineersOwn end-to-end infrastructure architecture below the application layer, including compute, container orchestration, CI/CD, observability, and securityPartner directly with clients and stakeholders to design, present, and deliver robust AI infrastructure solutionsArchitect and manage production-grade Kubernetes environments (AKS/EKS), including cluster operations and RBACDesign and operationalize RAG pipelines, including ingestion, chunking, embedding workflows, and vector database managementLead GPU infrastructure provisioning and optimization (NVIDIA A100/H100 or similar)Drive Infrastructure-as-Code adoption using Terraform and GitOps practices (ArgoCD/Flux)Build and maintain CI/CD pipelines using GitHub Actions and Azure DevOpsEstablish observability standards using Datadog, OpenTelemetry, and ELK/OpenSearchLead incident response, on-call processes, and post-mortem analysisEnsure strong security posture and lead InfoSec review processesCoordinate delivery across multiple teams and client engagementsBasic Qualifications:5–8 years of experience in Platform Engineering, SRE, or Infrastructure Engineering3+ years of Proven experience delivering and leading infrastructure for AI/LLM-based production systemsStrong hands-on expertise in Kubernetes, Docker, Helm3+ years of experience with Terraform and GitOps (ArgoCD/Flux)3+ years of experience with Azure (Key Vault, Monitor, DevOps Pipelines)3+ years of experience leading client-facing technical engagements3+ years of experience managing multiple concurrent projects or teams3+ years of Hands-on experience with incident management and SLA-driven environments3+ years of Experience leading security/InfoSec reviewsStrong understanding of vector databases, RAG pipelines, and LLM inference systems3+ years of Experience with CI/CD and container registry managementDegree:Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience.Nice to Have (But Not Required):Experience with AWS in addition to AzureFamiliarity with Azure API Management and AKSExperience with Pulumi (Python/TypeScript)Knowledge of NIM deployment and lifecycle managementPython scripting for infrastructure automationExperience with load testing tools (k6, Locust, JMeter)Exposure to FinOps and cost optimization practices","datePosted":"2026-05-20T18:22:00.934Z","dateModified":"2026-05-20T18:22:00.934Z","hiringOrganization":{"@type":"Organization","name":"Technogen","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"San Jose","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"2e5afa4755254e25aa8a25bf"},"url":"https://jobsearcher.com/jobs/2e5afa4755254e25aa8a25bf"}}