Software Developer

We're working with a leading AI organization that empowers the world's most innovative companies to refine their AI agents through human feedback. This organization collaborates with top AI entities to train Large Language Models (LLMs) to operate as proactive, multi-step agents, focusing on designing, coordinating, and optimizing complex, real-world architectural workflows.The Role Train generative AI models by providing skilled software expertise. Develop objective, verifiable criteria (rubrics) for system performance evaluation and functional requirement adherence. Review system logs and "trajectories" to refactor code and optimize execution paths. Test systems for vulnerabilities, including improper data exposure and unauthorized access. This is a fully remote, freelance role with flexible hours.What You'll Need 2+ years of experience in backend engineering, AI automation, or complex systems integration. Proven ability to build and maintain production-grade software with modular separation. Strong command of at least two major programming languages (e.g., Python, JavaScript, Go, or Java). Experience working with SQL databases. Practical experience building for live, non-mocked environments and handling multi-turn system interactions. Outstanding attention to detail and ability to provide clear, high-density technical feedback.What's On Offer Earn up to $50 per hour for core project work. Opportunities for additional incentives through "Missions" (surge pricing). Flexible working hours. The chance to contribute to the training of advanced generative systems.Apply via Haystack today!