Software Developer

We're working with a leading AI company that provides human feedback to improve the AI agents of the world's most innovative organizations. They collaborate with top AI researchers to train Large Language Models (LLMs) to function as proactive, multi-step agents, focusing on designing, coordinating, and optimizing complex, real-world architectural workflows.The Role Develop objective and verifiable criteria (rubrics) to evaluate system performance and ensure outputs meet strict functional requirements. Review system logs and "trajectories" to refactor code, improve execution paths, and achieve optimal reliability. Test systems for vulnerabilities, including improper data exposure, unauthorized access escalations, and edge-case failures. Help train generative AI models and shape the future of autonomous agents.What You'll Need 2+ years of experience in backend engineering, AI automation, or complex systems integration. Proven ability to build and maintain production-grade software with modular separation. Strong command of at least two major programming languages (e.g., Python, JavaScript, Go, or Java). Experience working with SQL databases. Practical experience building for live, non-mocked environments and handling multi-turn system interactions. Outstanding attention to detail and the ability to provide clear, high-density technical feedback on complex system behaviors.What's On Offer Fully remote freelance role with flexible hours. Competitive hourly rates, up to USD $50 per hour for core project work. Additional incentive opportunities, with top contributors earning more. The chance to contribute to cutting-edge generative AI systems.Apply via Haystack today!