AI Data Annotation
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Hiring: AI Conversational Agent Evaluation Experts We are looking for experienced professionals to support an AI Conversational Agent Evaluation project. Project Details
Duration: 2–3 months
Start: ASAPWork Type: Contract / Project-based
Languages: English (UK / US / Canada)🔹 AI Evaluation / Operator Role
Conduct live roleplay sessions with conversational AI agents Set up and verify required tools/access Capture session recordings, IDs, and relevant logs Label conversation transcripts Evaluate AI responses using structured rubrics Provide clear written justification for ratings Read and validate JSON structures Maintain clear, high-quality audio during sessions🔹 QA / Reviewer RoleWe are looking for candidates with experience in: AI data annotation, RLHF, AI evaluation, QA, or proofreading Audio engineering, music, broadcast, or audio production Linguistics, ESL/language teaching, or translation Computer Science, Engineering, Physics, or Applied Mathematics
Additional Requirements:
- Strong English speaking and listening skills
- Good analytical and attention-to-detail skills
- Technical literacy, including basic JSON understanding
- Reliable internet and a quiet environment for high-quality audio
- Multilingual skills are a plus