{"schemaVersion":"jobsearcher.job.v1","id":"b63a22fe25cdbcc9749f06d4","url":"https://jobsearcher.com/jobs/b63a22fe25cdbcc9749f06d4","canonicalUrl":"https://jobsearcher.com/jobs/b63a22fe25cdbcc9749f06d4","title":"AI Platform and Solutions Engineer","description":"Description\n\nInvent the future with us.\n\nAmpere is a semiconductor design company for a new era, leading the future of computing with an innovative approach to CPU design focused on high-performance, energy efficient, sustainable cloud computing.\n\nBy providing a new level of predictable performance, efficiency, and sustainability, Ampere is working with leading cloud suppliers and a growing partner ecosystem to deliver cloud instances, servers and embedded/edge products that can handle the compute demands of today and tomorrow.\n\nJoin us at Ampere and work alongside a passionate and growing team — we’d love to have you apply!\n\nAbout the role and team:\n\nAs an AI Platform & Solutions Engineer, you will build and operate Ampere’s internal AI platform and the user-facing tools that sit on top of it. You’ll deliver secure AI applications (chat/agent/workflow UIs), develop integrations that connect LLMs to enterprise systems, and run core platform components (vector/RAG services, model access, deployments, monitoring). Your work will directly improve developer productivity, knowledge discovery, and operational automation across the company while protecting Ampere IP.\n\nThis is a builder/operator role: ship features, wire them into real systems, and keep them reliable.\nAI Platform work at Ampere is focused on enabling every employee with practical, secure AI capabilities. The team builds foundational platform services and high-impact internal tools from the ground up, partnering with engineering, manufacturing, and operations to turn ambiguous workflows into deployed systems. You’ll operate close to production realities: identity, permissions, observability, cost controls, and uptime matter as much as model quality.\n\nWhat you’ll achieve:\n\nAI Infrastructure & Platform Operations\nCore stack: Python + FastAPI, Svelte/SvelteKit + TypeScript, Azure, Microsoft Entra.\nAI infrastructure management: Own and evolve core components like vector/RAG services, model access, model serving environments (cloud and on-prem where applicable), and underlying compute.\nContainerization & deployment: Package and deploy services with Docker, primarily to Azure VMs (and adjacent Azure services as needed).\nObservability & reliability: Implement logs/metrics/traces using Azure Monitor/Application Insights, build dashboards, and configure actionable alerts.\nSecrets, config, and access: Manage secrets via Key Vault, use managed identities, and enforce least-privilege access patterns.\nCI/CD: Build pipelines (GitHub Actions and/or Azure DevOps) for build/test/deploy across environments.\n\nBackend Services, RAG, and Enterprise Integrations\nBackend development: Build and extend FastAPI services (endpoints, adapters, background jobs, structured payloads, pagination, and error handling).\nModel Context Protocol (MCP) / tool integrations: Design and maintain MCP-style tools and connectors that link models/agents to enterprise systems like Jira/Confluence, ticketing systems, knowledge bases, NetSuite/manufacturing tools, and internal services.\nRAG implementation: Build practical RAG foundations: chunking, embeddings, retrieval filters/metadata, batch upserts, and index maintenance across vector/search systems.\nLLM integration: Integrate with LLM APIs (Azure Foundry/Google Vertex AI) including streaming and tool/function calling.\n\nAI Apps, Agents, and Workflow Surfaces\nInternal AI web apps: Own user-facing web UIs (primarily Svelte/SvelteKit + TypeScript) with strong fundamentals around routing, SSR, state, performance, and accessibility.\nReal-time AI UX: Implement streaming responses via SSE/WebSockets, resilient chat/task interfaces, incremental rendering, retries, and degraded-mode handling.\nAgents and workflow automation: Build multi-step agents and workflows with tool calls, approvals, progress events, audit trails, and safe failure modes.\nSolution delivery: Ship tools that improve day-to-day work, including internal chat/agent apps, workflow automation, and developer productivity integrations (e.g., VS Code, Open WebUI, external AI tools where appropriate).\n\nSecurity, Identity, and Safe Enterprise AI\nAuthentication and authorization: Implement Microsoft Entra ID auth for web apps/APIs using OIDC/OAuth2 (MSAL), validate tokens (JWT/JWKS), and enforce scopes/RBAC.\nData protection and auditability: Ensure safe enterprise use of LLMs with clear permission boundaries, logging/audit trails, and secure handling of sensitive data.\n\nPlatform Enablement\n\nPartner with internal teams (engineering, manufacturing, ops) to gather requirements, translate them into working systems, document architecture and playbooks, and support adoption.\n\nAbout you:\n\nBachelors degree & 2 years of related experience; or an advanced degree without experience.\nSoftware engineering experience delivering production systems (or equivalent portfolio).\n\nStrong Python proficiency (required) with experience building production services (FastAPI preferred).\n\nFrontend capability: Strong TypeScript/JavaScript fundamentals and experience with a modern framework (Svelte preferred; React/Vue acceptable).\n\nHands-on experience integrating LLM APIs including streaming and tool/function calling.\n\nWorking understanding of RAG and vector search fundamentals.\n\nExperience deploying and operating applications in cloud environments (Azure strongly preferred).\n\nPractical knowledge of REST APIs and integration patterns.\n\nWorking understanding of OIDC/OAuth2 and web auth flows; Entra ID experience strongly preferred.\n\nGit proficiency (branching, PRs, code review) and comfort in Linux dev environments.\n\nAbility to operate independently: take ambiguous problems, ship solutions, and own them through deployment and iteration.\n\nClear technical communication: can explain tradeoffs and designs to both technical and non-technical stakeholders.\nNice to Have\n\nDirect MCP development experience (clients/servers; OAuth 2.1).\n\nVector DB and search ops: Chroma/Pinecone/Weaviate/Qdrant/Azure AI Search, ingestion pipelines, indexing strategy.\n\nInfrastructure as Code: Terraform/Bicep.\n\nStrong CI/CD practices: quality gates, smoke tests, environment promotion.\n\nCaching/rate limiting/cost controls: Redis, batching, token/cost telemetry.\n\nTesting discipline: pytest/Vitest, Playwright, contract testing.\n\nOn-prem or hybrid infrastructure exposure; model serving environments.\n\nInternal developer tooling experience (VS Code extensions, CLIs, internal portals like Open WebUI).\n\nDeeper LLM/RAG evaluation and safety: prompt injection defenses, retrieval evaluation, regression tests, A/B testing, auditability.\n\nExposure to fine-tuning concepts (LoRA/QLoRA) and agent-system failure modes/monitoring.\n\nCore ML fundamentals: supervised/unsupervised learning, bias/variance, overfitting, regularization, cross-validation, metrics.\n\nDeep learning basics: embeddings, attention/transformers at a conceptual level, training vs inference constraints.\n\nLLM-specific mechanics: tokenization, context windows, temperature/top-p, latency/cost tradeoffs, prompt vs fine-tune boundaries.\n\nRAG depth: chunking strategies, embedding model selection, retrieval evaluation (recall@k, MRR), rerankers, hybrid search, query rewriting.\n\nEvaluation discipline: offline eval harnesses, labeled test sets, prompt regression tests, A/B testing, human eval workflows.\n\nSafety/security: prompt injection, data exfiltration paths, least-privilege tool access, sandboxing, output validation.\n\nAgentic systems understanding: planning vs execution, tool selection, state management, failure modes, monitoring agent behavior.\nWhat we’ll offer:\nAt Ampere we believe in taking care of our employees and providing a competitive total rewards package that includes base pay, bonus (i.e., variable pay tied to internal company goals, long-term incentive, and comprehensive benefits. The full base pay range for this role is between $98,500 and $164,000.\nOur benefits include health, wellness, and financial programs that support employees through every stage of life, with full benefits eligibility at 20 hours per week.\nBenefit highlights include:\nPremium medical insurance, dental insurance, vision insurance, as well as income protection and a 401K retirement plan, so that you can feel secure in your health and financial future.\nUnlimited Flextime and 10+ paid holidays so that you can embrace a healthy work-life balance.\nA variety of healthy snacks, energizing espresso, and refreshing drinks to keep you fueled and focused throughout the day.\nAnd there is much more than compensation and benefits. At Ampere, we foster an inclusive culture that empowers our employees to do more and grow more. We are passionate about inventing industry leading cloud-native designs that contribute to a more sustainable future. We are excited to share more about our career opportunities with you through the interview process.\n#LI-Hybrid\n\nAmpere is an inclusive and equal opportunity employer and welcomes applicants from all backgrounds. All qualified applicants will receive consideration for employment without regard to race, color, national origin, citizenship, religion, age, veteran and/or military status, sex, sexual orientation, gender, gender identity, gender expression, physical or mental disability, or any other basis protected by federal, state or local law.","company":"Ampere Computing","rawCompany":"ampere computing","city":"Durham","state":"NC","isRemote":false,"isActive":false,"createdAt":"2026-04-14T10:56:30.043Z","occupations":[{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1221.00","title":"Computer and Information Research Scientists","slug":"computer-and-information-research-scientists"}],"industries":[{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"AI Platform and Solutions Engineer","description":"Description\n\nInvent the future with us.\n\nAmpere is a semiconductor design company for a new era, leading the future of computing with an innovative approach to CPU design focused on high-performance, energy efficient, sustainable cloud computing.\n\nBy providing a new level of predictable performance, efficiency, and sustainability, Ampere is working with leading cloud suppliers and a growing partner ecosystem to deliver cloud instances, servers and embedded/edge products that can handle the compute demands of today and tomorrow.\n\nJoin us at Ampere and work alongside a passionate and growing team — we’d love to have you apply!\n\nAbout the role and team:\n\nAs an AI Platform & Solutions Engineer, you will build and operate Ampere’s internal AI platform and the user-facing tools that sit on top of it. You’ll deliver secure AI applications (chat/agent/workflow UIs), develop integrations that connect LLMs to enterprise systems, and run core platform components (vector/RAG services, model access, deployments, monitoring). Your work will directly improve developer productivity, knowledge discovery, and operational automation across the company while protecting Ampere IP.\n\nThis is a builder/operator role: ship features, wire them into real systems, and keep them reliable.\nAI Platform work at Ampere is focused on enabling every employee with practical, secure AI capabilities. The team builds foundational platform services and high-impact internal tools from the ground up, partnering with engineering, manufacturing, and operations to turn ambiguous workflows into deployed systems. You’ll operate close to production realities: identity, permissions, observability, cost controls, and uptime matter as much as model quality.\n\nWhat you’ll achieve:\n\nAI Infrastructure & Platform Operations\nCore stack: Python + FastAPI, Svelte/SvelteKit + TypeScript, Azure, Microsoft Entra.\nAI infrastructure management: Own and evolve core components like vector/RAG services, model access, model serving environments (cloud and on-prem where applicable), and underlying compute.\nContainerization & deployment: Package and deploy services with Docker, primarily to Azure VMs (and adjacent Azure services as needed).\nObservability & reliability: Implement logs/metrics/traces using Azure Monitor/Application Insights, build dashboards, and configure actionable alerts.\nSecrets, config, and access: Manage secrets via Key Vault, use managed identities, and enforce least-privilege access patterns.\nCI/CD: Build pipelines (GitHub Actions and/or Azure DevOps) for build/test/deploy across environments.\n\nBackend Services, RAG, and Enterprise Integrations\nBackend development: Build and extend FastAPI services (endpoints, adapters, background jobs, structured payloads, pagination, and error handling).\nModel Context Protocol (MCP) / tool integrations: Design and maintain MCP-style tools and connectors that link models/agents to enterprise systems like Jira/Confluence, ticketing systems, knowledge bases, NetSuite/manufacturing tools, and internal services.\nRAG implementation: Build practical RAG foundations: chunking, embeddings, retrieval filters/metadata, batch upserts, and index maintenance across vector/search systems.\nLLM integration: Integrate with LLM APIs (Azure Foundry/Google Vertex AI) including streaming and tool/function calling.\n\nAI Apps, Agents, and Workflow Surfaces\nInternal AI web apps: Own user-facing web UIs (primarily Svelte/SvelteKit + TypeScript) with strong fundamentals around routing, SSR, state, performance, and accessibility.\nReal-time AI UX: Implement streaming responses via SSE/WebSockets, resilient chat/task interfaces, incremental rendering, retries, and degraded-mode handling.\nAgents and workflow automation: Build multi-step agents and workflows with tool calls, approvals, progress events, audit trails, and safe failure modes.\nSolution delivery: Ship tools that improve day-to-day work, including internal chat/agent apps, workflow automation, and developer productivity integrations (e.g., VS Code, Open WebUI, external AI tools where appropriate).\n\nSecurity, Identity, and Safe Enterprise AI\nAuthentication and authorization: Implement Microsoft Entra ID auth for web apps/APIs using OIDC/OAuth2 (MSAL), validate tokens (JWT/JWKS), and enforce scopes/RBAC.\nData protection and auditability: Ensure safe enterprise use of LLMs with clear permission boundaries, logging/audit trails, and secure handling of sensitive data.\n\nPlatform Enablement\n\nPartner with internal teams (engineering, manufacturing, ops) to gather requirements, translate them into working systems, document architecture and playbooks, and support adoption.\n\nAbout you:\n\nBachelors degree & 2 years of related experience; or an advanced degree without experience.\nSoftware engineering experience delivering production systems (or equivalent portfolio).\n\nStrong Python proficiency (required) with experience building production services (FastAPI preferred).\n\nFrontend capability: Strong TypeScript/JavaScript fundamentals and experience with a modern framework (Svelte preferred; React/Vue acceptable).\n\nHands-on experience integrating LLM APIs including streaming and tool/function calling.\n\nWorking understanding of RAG and vector search fundamentals.\n\nExperience deploying and operating applications in cloud environments (Azure strongly preferred).\n\nPractical knowledge of REST APIs and integration patterns.\n\nWorking understanding of OIDC/OAuth2 and web auth flows; Entra ID experience strongly preferred.\n\nGit proficiency (branching, PRs, code review) and comfort in Linux dev environments.\n\nAbility to operate independently: take ambiguous problems, ship solutions, and own them through deployment and iteration.\n\nClear technical communication: can explain tradeoffs and designs to both technical and non-technical stakeholders.\nNice to Have\n\nDirect MCP development experience (clients/servers; OAuth 2.1).\n\nVector DB and search ops: Chroma/Pinecone/Weaviate/Qdrant/Azure AI Search, ingestion pipelines, indexing strategy.\n\nInfrastructure as Code: Terraform/Bicep.\n\nStrong CI/CD practices: quality gates, smoke tests, environment promotion.\n\nCaching/rate limiting/cost controls: Redis, batching, token/cost telemetry.\n\nTesting discipline: pytest/Vitest, Playwright, contract testing.\n\nOn-prem or hybrid infrastructure exposure; model serving environments.\n\nInternal developer tooling experience (VS Code extensions, CLIs, internal portals like Open WebUI).\n\nDeeper LLM/RAG evaluation and safety: prompt injection defenses, retrieval evaluation, regression tests, A/B testing, auditability.\n\nExposure to fine-tuning concepts (LoRA/QLoRA) and agent-system failure modes/monitoring.\n\nCore ML fundamentals: supervised/unsupervised learning, bias/variance, overfitting, regularization, cross-validation, metrics.\n\nDeep learning basics: embeddings, attention/transformers at a conceptual level, training vs inference constraints.\n\nLLM-specific mechanics: tokenization, context windows, temperature/top-p, latency/cost tradeoffs, prompt vs fine-tune boundaries.\n\nRAG depth: chunking strategies, embedding model selection, retrieval evaluation (recall@k, MRR), rerankers, hybrid search, query rewriting.\n\nEvaluation discipline: offline eval harnesses, labeled test sets, prompt regression tests, A/B testing, human eval workflows.\n\nSafety/security: prompt injection, data exfiltration paths, least-privilege tool access, sandboxing, output validation.\n\nAgentic systems understanding: planning vs execution, tool selection, state management, failure modes, monitoring agent behavior.\nWhat we’ll offer:\nAt Ampere we believe in taking care of our employees and providing a competitive total rewards package that includes base pay, bonus (i.e., variable pay tied to internal company goals, long-term incentive, and comprehensive benefits. The full base pay range for this role is between $98,500 and $164,000.\nOur benefits include health, wellness, and financial programs that support employees through every stage of life, with full benefits eligibility at 20 hours per week.\nBenefit highlights include:\nPremium medical insurance, dental insurance, vision insurance, as well as income protection and a 401K retirement plan, so that you can feel secure in your health and financial future.\nUnlimited Flextime and 10+ paid holidays so that you can embrace a healthy work-life balance.\nA variety of healthy snacks, energizing espresso, and refreshing drinks to keep you fueled and focused throughout the day.\nAnd there is much more than compensation and benefits. At Ampere, we foster an inclusive culture that empowers our employees to do more and grow more. We are passionate about inventing industry leading cloud-native designs that contribute to a more sustainable future. We are excited to share more about our career opportunities with you through the interview process.\n#LI-Hybrid\n\nAmpere is an inclusive and equal opportunity employer and welcomes applicants from all backgrounds. All qualified applicants will receive consideration for employment without regard to race, color, national origin, citizenship, religion, age, veteran and/or military status, sex, sexual orientation, gender, gender identity, gender expression, physical or mental disability, or any other basis protected by federal, state or local law.","datePosted":"2026-04-14T10:56:30.043Z","dateModified":"2026-04-14T10:56:30.043Z","hiringOrganization":{"@type":"Organization","name":"Ampere Computing","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Durham","addressRegion":"NC","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"b63a22fe25cdbcc9749f06d4"},"url":"https://jobsearcher.com/jobs/b63a22fe25cdbcc9749f06d4"}}