Remote Data Annotation Specialist (Barcelona)
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
About The Role:
As a Remote Data Annotation Specialist (Barcelona) on Rex.zone, you will label and evaluate multi-modal AI training data to improve large language model evaluation and downstream model behavior. This is a full-time, fully remote role (US job metadata) supporting Barcelona-oriented search intent and locale data when needed.
What You Will Do:
- Execute NLP data labeling: intent tagging, sentiment/topic classification, and named entity recognition (NER)
- Perform RLHF preference ranking and pairwise comparisons for prompt evaluation, with concise written rationales
- Run QA evaluation on labeled datasets, resolve conflicts, and document edge cases
- Annotate computer vision data when required (bounding boxes, polygons, keypoints, image classification)
- Conduct content safety labeling (toxicity, self-harm, hate, sexual content) with policy adherence
- Track production metrics (throughput, accuracy, inter-annotator agreement) and support calibration
- Collaborate asynchronously via Rex.zone tools and follow secure data handling procedures
Required Skills And Experience:
- Mid-Senior experience in data annotation, data labeling, QA evaluation, or search relevance evaluation
- Strong rubric adherence and consistent decision-making; high annotation guidelines compliance
- Strong written English for rationale-based grading and prompt-response evaluation
- Familiarity with NLP concepts and LLM evaluation workflows
- Comfort with web-based annotation tools and spreadsheet-like workflows
Work ModelFULL_TIME and fully Remote with asynchronous collaboration. Quality is measured via audits, gold tasks, inter-annotator agreement, and QA reviews focused on training data quality and consistency.
Compensation is hourly and depends on project complexity and calibration accuracy.