Audio Speech Evaluator

Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are an AI technology solutions provider-of-choice for 4 out of 5 of the world’s biggest technology companies, as well as leading companies across financial services, insurance, technology, law, and medicine.By combining advanced machine learning and artificial intelligence (ML/AI) technologies, a global workforce of subject matter experts, and a high-security infrastructure, we’re helping usher in the promise of AI. Innodata offers a powerful combination of both digital data solutions and easy-to-use, high-quality platforms.Our global workforce includes over 5,000 employees in the United States, Canada, United Kingdom, the Philippines, India, Sri Lanka, Israel and Germany.About the role:We are seeking detail-oriented evaluators to conduct human quality evaluations for an enterprise AI customer support product on different social media platform. You will evaluate and benchmark AI model responses against complex evaluation rubrics using provided business knowledge bases.Project Details:Job Role: Audio Speech Evaluator – ExpertDuration: 1 month (extendable)Eligibility: Native Australian/UK/USThere will be 3 hour paid assessment which has to be qualified and then only you will be onboarded for the project.We are looking for experienced Audio Speech Evaluators who are native English speakers from the Australia to support an AI speech evaluation project.The role involves having natural, unscripted conversations with an AI bot, followed by evaluating the interaction based on tone, accent, pronunciation, fluency, naturalness, clarity, and overall conversational quality.Each task takes approximately 20 minutes, and evaluators must provide accurate, objective, and constructive feedback based on the project guidelines.Key Responsibilities :Engage in natural, conversational interactions with an AI bot across different topics and scenarios.Follow the provided task instructions while maintaining a natural conversational flow.Evaluate the AI's speech and conversational responses after completing each task.Assess aspects such as tone, accent, pronunciation, fluency, naturalness, clarity, pacing, and overall conversational quality.Provide clear and specific feedback based on the evaluation guidelines and defined rubrics.Complete assigned tasks within the expected turnaround time and maintain required productivity levels.Candidate Requirements: Must be a native English speaker from the Australia/ United Kingdom/United StatesAbility to identify subtle differences in tone, accent, pronunciation, and conversational style.Comfortable participating in approximately 20-minute conversational sessions.Prior experience in audio evaluation, speech data collection, linguistic evaluation, AI/LLM evaluation, content moderation, quality assurance, or similar roles is preferred but not mandatory, unless otherwise specified.If you're ready to contribute to the future of AI while working remotely on an exciting music-focused project, we'd love to hear from you!