Software Developer

We're working with a cutting-edge platform that helps the world's most innovative companies refine their AI agents through human feedback. They empower leading AI organizations to train Large Language Models (LLMs) to become proactive, multi-step agents, focusing on designing, coordinating, and optimizing complex, real-world architectural workflows.The Role Help train generative AI models by contributing your software expertise. Develop objective, verifiable criteria (rubrics) to evaluate system performance and ensure outputs meet strict functional requirements. Review system logs and "trajectories" to refactor code, improve execution paths, and reach a "Golden Path" of perfect reliability. Test systems for vulnerabilities, including improper data exposure, unauthorized access escalations, and edge-case failures. This is a fully remote, freelance role with flexible hours.What You'll Need 2+ years of experience in backend engineering, AI automation, or complex systems integration. Proven ability to build and maintain production-grade software with modular separation. Strong command of at least two major languages (e.g., Python, JavaScript, Go, or Java) and experience with SQL databases. Practical experience building for live, non-mocked environments and handling multi-turn system interactions. Outstanding attention to detail and the ability to provide clear, high-density technical feedback on complex system behaviors. Experience identifying subtle failures like privacy leaks, authority escalation, or indirect prompt injections.What's On Offer Opportunity to shape the future of autonomous agents and work on advanced generative systems. Flexible work schedule with remote work. Competitive project rates up to USD $50 per hour for core project work. Additional incentives averaging 7.5% through "Missions" (surge pricing).Apply via Haystack today!