JOBSEARCHER

Senior ML Infrastructure Engineer / AI Systems / $310,000 W2 / Hybrid (2 days) / New York, NY

Open TalentNew York, NYApril 12th, 2026
Senior ML Infrastructure Engineer / AI Systems / $310,000 W2 / Hybrid (2 days) / New York, NYRole: Senior ML Infrastructure Engineer (Python, Distributed Systems, MLOps)Salary: $220K-$310K W-2Location & Policy: Hybrid - 2 days/week in NYC office; U.S. candidates only (W-2).Stack: Python 3.10+, PyTorch, Ray, Kafka, FastAPI, Kubernetes (EKS), Airflow, Spark, PostgreSQL, Redis, AWS (SageMaker, Lambda, SQS, DynamoDB), Terraform, CI/CD (GitHub Actions), Prometheus, GrafanaThe companyA venture-backed AI infrastructure company building the backbone for mission-critical, real-time systems. From multi-agent orchestration to ultra-low latency model serving, our platform powers high-stakes industries including healthcare, logistics & defense.They are scaling fast and need engineers who thrive at the intersection of ML + backend infra.Why joinArchitect & scale ML infra that supports millions of real-time decisions per secondWork cross-functionally with AI researchers, backend engineers & product to ship directly into productionOwn greenfield problems: distributed inference, autoscaling pipelines, fail-safe model governanceShape a culture of engineering autonomy in a product-obsessed companyWhat you’ll doDesign & optimize large-scale ML serving infra (streaming, time-series, multi-agent workflows)Build & productionize Python APIs & distributed systems for real-time inferenceEngineer data/feature pipelines with Spark, Kafka & Airflow, ensuring 99.99% uptimeDeploy models across Kubernetes & AWS with auto-scaling, monitoring & retrainingImplement full MLOps lifecycle: automated CI/CD, shadow deployments, A/B testing, observabilityNice to haveExperience in multi-agent frameworks, model orchestration, or applied reinforcement learningFamiliarity with explainability, safety checks, or compliance frameworksBackground in regulated or mission-critical domains (health, energy, logistics, defense)Interview processScreening call (30 mins)Technical deep-dive with Principal Engineer (60 mins)Architecture exercise with product/infra team (45 mins)CTO conversation & offerOn offerSalary: $220K-$310K W-2Equity in a hyper-growth AI infra startup401(k) with employer matchHealth, dental & vision insurance (premiums covered)20 days PTO + 10 holidaysFlexible parental leave & family supportProfessional growth budget (conferences, certs, advanced training)*Equal Opportunity*We're hiring for an Equal Opportunity Employer.Due to a strong response from the market, please apply immediately or email sufy@opentalent.uk to avoid missing out.*All our new jobs are posted here 1st:linkedin.com/in/sufyanbashir/