AI Platform Optimization Lead Engineer
We are seeking an experienced AI Platform Optimization Lead Engineer to lead the architecture, development, and optimization of enterprise-scale AI platforms and Large Language Model (LLM) infrastructure.
The ideal candidate will have strong technical leadership experience in platform-level optimization, cost management, reliability engineering, and consumption architecture. The role requires hands-on expertise in LLM gateways, model routing, token metering, rate limiting, quota management, observability, caching, batching, and model evaluation.
Must-Have Technical Skills
LLM Gateway Architecture
LLM Model Routing
Token Metering & Usage Tracking
API Rate Limiting
Quota Management
AI Platform Optimization
Cost & Consumption Architecture
Platform Reliability Engineering
Observability & Monitoring
Caching Strategies
Request Batching
LLM Evaluation Frameworks
AI Infrastructure Architecture
Performance Optimization
Technical Leadership
Required Qualifications:
8–10 years of experience in platform engineering, infrastructure engineering, cloud engineering, or related technical roles.
Strong experience leading platform-level cost, reliability, and consumption optimization initiatives.
Hands-on experience with LLM gateways and model routing architectures.
Experience implementing token metering, API rate limits, and quota management.
Strong understanding of observability, monitoring, and performance optimization.
Experience implementing caching and batching strategies.
Knowledge of LLM evaluation methodologies and performance benchmarking.
Strong architectural design and technical leadership capabilities.
Excellent problem-solving and cross-functional collaboration skills.