Lead Software Platform Engineer, MLOps
For our client, we are seeking a Lead Software Platform Engineer, MLOps to join the team of a leader in the Enterprise Technology space. This role will shape the architecture of a multi-tenant AI/ML platform that supports external users and production workloads at scale. You will lead technical decisions across model lifecycle management, inference services, security, and observability to ensure the platform is reliable, performant, and cost-effective. The position calls for a hands-on engineering leader who can partner closely with security, infrastructure, and application teams to bring AI capabilities into production with confidence.
Location: Remote
Compensation: $200,000 – $270,000 annually
Responsibilities:
Own the technical architecture of the AI/ML platform and its APIs Manage the model and prompt lifecycle across MLflow and AWS Bedrock Design the inference substrate for real-time and batch AI workloads Integrate AI models and LLMs into production systems with effective architectures Implement security measures into the AI platform in collaboration with security teams Build evaluation and quality infrastructure for robust AI deployment Establish observability for the AI platform, including monitoring and alerting
Qualifications:
10+ years of professional experience in software and infrastructure engineering, with a focus on distributed, cloud-native systems Proven technical leadership or architecture experience, with responsibility for system design, scalability, performance, and cost optimization decisions Experience designing multi-tenant platform security, including authorization and handling sensitive data such as PII and PHI Extensive experience with AI/ML infrastructure in production, especially as a multi-tenant product for external users Hands-on experience with LLM-based systems in production, including real traffic and failure modes Expert coding skills in TypeScript and Python, along with strong judgment for evaluating AI-generated code Production-level experience with a model registry and serving stack, ideally Databricks MLflowBenefits 100% employer-paid benefits for eligible employees and their families Unlimited paid time off (PTO) 401K Flexible remote working arrangements Company-paid life insurance, limited/short-term disability Culture of continuous improvement with career growth opportunities Our client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.