JOBSEARCHER

Principal Software Engineer

HaystackNy, WALJune 5th, 2026
We're hiring on behalf of a Haystack partner!The Role Design, build, and evolve reliable, secure, and cost-efficient platform capabilities for machine learning. Take a hands-on role across enterprise repositories, improving shared services, CI/CD workflows, and infrastructure patterns. Conduct deep technical investigations of performance and scalability issues, including optimizing GPU utilization and resource efficiency across ML workloads. Set platform strategy and standards for ML packaging, deployment, serving, and observability. Partner with Data Scientists to package, scale, and operationalize models and define APIs and automation. Lead cross-platform incident response and post-mortems, driving systemic fixes and evolving standards.What You'll Need Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related discipline. 8+ years building and operating production platforms and services at scale. Deep software engineering expertise in Python and distributed systems, with Linux fluency and scripting skills. Hands-on experience with AWS services like S3, Lambda, Batch, Step Functions, EventBridge, CloudWatch, and SNS/SQS. Experience with DevOps and CI/CD at scale, including Docker and Git-based workflows. Proficiency in Infrastructure as Code (CloudFormation, Terraform/OpenTofu) and platform reliability engineering.What's On Offer Comprehensive health care coverage and emotional well-being support. Market-leading retirement and generous paid time off and parental leave. Charitable giving employee match program. Educational assistance including student loan repayment, tuition reimbursement, and learning resources.Apply via Haystack today!