Data Annotator | Remote

Generalist Evaluation Expert Remote | $60-$200 per hour | Flexible / Project-BasedQuick SnapshotEvaluate model-generated responses and provide structured, high-quality written feedbackWork on frontier language model evaluation and research-focused projectsIndependent contractor role with fully remote, flexible schedulingWeekly payouts via Stripe or Wise based on completed workStrong emphasis on analytical thinking, reasoning quality, and written clarityTasks require strict adherence to structured evaluation guidelines and rubricsNo automated writing tools allowed; work must be completed independentlyRequirementsEvaluate and compare model-generated outputs using structured evaluation criteriaIdentify reasoning gaps, implicit assumptions, inconsistencies, and nuanced errorsProduce clear, precise, and well-supported written rationalesApply detailed evaluation rubrics with strict attention to accuracy and consistencyDemonstrate strong critical reading skills and independent judgment in assessmentsStrong analytical thinking and written communication skills; top-tier academic background preferredMaintain high-quality standards while working fully independently without automated writing toolsEasy apply to proceed.