Remote Data Labeling Specialist (India)

Remote Data Labeling Jobs in IndiaRex.zone is hiring a Remote Data Labeling Specialist to create and validate labeled training data for AI/ML systems, including LLM evaluation workflows. You will follow detailed annotation guidelines, document edge cases, and collaborate with QA reviewers to improve training data quality and downstream model performance.What You Will DoLabel and review text, image, and multimodal data for AI/ML use casesPerform RLHF-style preference ranking and prompt evaluation for large language model evaluationExecute QA evaluation checks, resolve disagreements, and reduce annotation varianceMaintain annotation guidelines compliance and escalate ambiguous policy edge casesContribute to training data quality metrics (accuracy vs. gold sets, audits, inter-annotator agreement)Collaborate asynchronously with project leads across AI labs, tech startups, BPO teams, and annotation vendorsKey WorkflowsNLP: classification, intent, named entity recognition, entity linking, taxonomy taggingComputer Vision: bounding boxes, polygons, keypoints, segmentation masks, OCR taggingContent Safety: policy-based labeling, moderation categories, sensitive attributes handlingLLM Evaluation: response grading, hallucination checks, factuality review, safety alignment, RLHF rankingQuality Systems: gold-set calibration, audit sampling, error taxonomyRequirementsMid-to-senior experience in data labeling/data annotation with measurable QA outcomesStrong English reading comprehension and careful instruction-following for rubric-based evaluationComfort with annotation tools, task queues, and remote QA workflowsAbility to apply consistent labeling decisions and document edge cases clearlyCompensationCompetitive hourly rate: $30–$50 per hour (based on skills and program needs).