Rex.Zone is hiring a full-time Remote Data Annotator to produce and validate labeled datasets that improve AI/ML systems across NLP, computer vision, and multimodal workflows. You will follow detailed rubrics, resolve edge cases, and support LLM training pipelines through RLHF, prompt evaluation, QA evaluation, and content safety labeling.What You Will DoPerform data labeling for text, images, audio, and video using project toolsCreate RLHF preference comparisons, rankings, and evaluation examplesExecute QA evaluation checks for accuracy, consistency, and ambiguity handling;
report systematic issuesConduct prompt evaluation and response grading for large language model evaluationApply named entity recognition (NER) tagging, classification, and extraction per guidelinesComplete computer vision annotation (bounding boxes, polygons, keypoints, segmentation) as neededPerform content safety labeling for categories like hate, harassment, sexual content, and self-harmMaintain audit trails,



follow secure data handling procedures, and meet throughput targetsRequired QualificationsExperience in data annotation/data labeling with measurable quality outcomesAbility to follow complex rubrics and apply annotation guidelines consistentlyFamiliarity with QA concepts (e.G., inter-annotator agreement, error categorization)Comfort working with NLP and/or computer vision datasetsStrong written communication for issue reporting and adjudication notesAbility to work full-time remotely with reliable connectivity and secure work practicesHow Quality Is EnsuredGuidelines compliance checks, gold-standard calibration, peer review, and adjudicationQA evaluation metrics focused on accuracy, consistency, and reducing error patternsPayCompetitive hourly rate: $30-$50/hour (based on project scope and performance).

📌 Remote Data Annotator Jobs Barcelona
🏢 Rex.zone
📍 Barcelona