AI Platform Engineer
About Our Client:
The organization operates in the technology consulting and software development sector, delivering cloud, AI, data, and enterprise solutions across the United States. It addresses challenges related to scalable and efficient AI and machine learning platform deployment, supporting production workloads with a focus on performance and reliability.
About the Opportunity:
The AI PLATFORM ENGINEER role focuses on designing, building, and operating scalable AI inference and model-serving platforms for production machine learning workloads. The position is responsible for optimizing performance, reliability, and observability of AI services using cloud-native infrastructure and distributed systems, ensuring that AI models operate effectively at scale.
Responsibilities:
Design and maintain scalable AI model-serving platforms.
Optimize inference performance, GPU utilization, request routing, and memory management.
Build and manage autoscaling, deployment, and monitoring solutions.
Implement caching, security controls, authentication, authorization, and high-availability strategies.
Collaborate with AI researchers, ML engineers, DevOps, and software engineers to deploy and support production AI models.
Develop monitoring, observability, logging, distributed tracing, and alerting systems.
Drive cloud infrastructure optimization and operational excellence.
Mentor engineering teams and establish best practices for AI platform engineering.
Evaluate emerging AI infrastructure technologies and model-serving frameworks.
Requirements:
- Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Artificial Intelligence, or related technical discipline.6+ years (up to 10+ years for senior roles) experience in distributed systems, infrastructure engineering, cloud platforms, or ML platform engineering.
- Strong programming skills in Python and at least one systems programming language such as Go, Rust, or C++.Experience with LLM serving frameworks such as vLLM, TensorRT-LLM, Triton Inference Server, or Ray Serve.
- Expertise in Kubernetes, container orchestration, Docker, and cloud-native architectures.
- Experience in GPU optimization using CUDA and NVIDIA GPU technologies.
- Familiarity with cloud platforms including AWS, Azure, or Google Cloud.
- Strong understanding of distributed systems, networking, scalability, observability, and security best practices.
- Excellent analytical, communication, collaboration, and technical leadership skills.
- Pay Range and Compensation Package:
- Salary ranges from $100,000 to $180,000 annually depending on experience.
Equal Opportunity Statement: Our client is an equal opportunity employer. They celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, or national origin.
Note:
RemoteHunter is a recruitment partner of this role. Please note that all employment decisions, including candidate assessment, interviews, hiring, compensation, and employment terms, are made exclusively by the hiring employer.