JOBSEARCHER

AI Platform Optimization Lead Engineer

We are seeking an experienced AI Platform Optimization Lead Engineer to lead the architecture, development, and optimization of enterprise-scale AI platforms and Large Language Model (LLM) infrastructure. The ideal candidate will have strong technical leadership experience in platform-level optimization, cost management, reliability engineering, and consumption architecture. The role requires hands-on expertise in LLM gateways, model routing, token metering, rate limiting, quota management, observability, caching, batching, and model evaluation. Must-Have Technical Skills LLM Gateway Architecture LLM Model Routing Token Metering & Usage Tracking API Rate Limiting Quota Management AI Platform Optimization Cost & Consumption Architecture Platform Reliability Engineering Observability & Monitoring Caching Strategies Request Batching LLM Evaluation Frameworks AI Infrastructure Architecture Performance Optimization Technical Leadership
Required Qualifications: 8–10 years of experience in platform engineering, infrastructure engineering, cloud engineering, or related technical roles. Strong experience leading platform-level cost, reliability, and consumption optimization initiatives. Hands-on experience with LLM gateways and model routing architectures. Experience implementing token metering, API rate limits, and quota management. Strong understanding of observability, monitoring, and performance optimization. Experience implementing caching and batching strategies. Knowledge of LLM evaluation methodologies and performance benchmarking. Strong architectural design and technical leadership capabilities. Excellent problem-solving and cross-functional collaboration skills.