Remote Data Annotation Specialist (Barcelona)

About The RoleAs a Remote Data Annotation Specialist (Barcelona) on Rex.zone, you will label and evaluate multi-modal AI training data to improve large language model evaluation and downstream model behavior. This is a full-time, fully remote role (US job metadata) supporting Barcelona-oriented search intent and locale data when needed.What You Will DoExecute NLP data labeling: intent tagging, sentiment/topic classification, and named entity recognition (NER)Perform RLHF preference ranking and pairwise comparisons for prompt evaluation, with concise written rationalesRun QA evaluation on labeled datasets, resolve conflicts, and document edge casesAnnotate computer vision data when required (bounding boxes, polygons, keypoints, image classification)Conduct content safety labeling (toxicity, self-harm, hate, sexual content) with policy adherenceTrack production metrics (throughput, accuracy, inter-annotator agreement) and support calibrationCollaborate asynchronously via Rex.zone tools and follow secure data handling proceduresRequired Skills And ExperienceMid-Senior experience in data annotation, data labeling, QA evaluation, or search relevance evaluationStrong rubric adherence and consistent decision-making; high annotation guidelines complianceStrong written English for rationale-based grading and prompt-response evaluationFamiliarity with NLP concepts and LLM evaluation workflowsComfort with web-based annotation tools and spreadsheet-like workflowsWork ModelFULL_TIME and fully Remote with asynchronous collaboration. Quality is measured via audits, gold tasks, inter-annotator agreement, and QA reviews focused on training data quality and consistency.Compensation is hourly and depends on project complexity and calibration accuracy.