Rex.zone is hiring a full-time Remote Data Annotator to produce and validate labeled datasets that improve AI/ML systems across NLP, computer vision, and multimodal workflows. You will follow detailed rubrics, resolve edge cases, and support LLM training pipelines through RLHF, prompt evaluation, QA evaluation, and content safety labeling.
What You Will Do Perform data labeling for text, images, audio, and video using project tools
Create RLHF preference comparisons, rankings, and evaluation examples
Execute QA evaluation checks for accuracy, consistency, and ambiguity handling; report systematic issues
Conduct prompt evaluation and response grading for large language model evaluation
Apply named entity recognition (NER) tagging, classification, and extraction per guidelines
Complete computer vision annotation (bounding boxes, polygons, keypoints, segmentation) as needed
Perform content safety labeling for categories like hate, harassment, sexual content, and self-harm
Maintain audit trails,



follow secure data handling procedures, and meet throughput targets
Required Qualifications Experience in data annotation/data labeling with measurable quality outcomes
Ability to follow complex rubrics and apply annotation guidelines consistently
Familiarity with QA concepts (e.g., inter-annotator agreement, error categorization)
Comfort working with NLP and/or computer vision datasets
Strong written communication for issue reporting and adjudication notes
Ability to work full-time remotely with reliable connectivity and secure work practices
How Quality Is Ensured Guidelines compliance checks, gold-standard calibration, peer review, and adjudication
QA evaluation metrics focused on accuracy, consistency, and reducing error patterns

Pay Competitive hourly rate: $30-$50/hour (based on project scope and performance).

#J-18808-Ljbffr

📌 Remote Data Annotator Jobs Barcelona (Sevilla)
🏢 Rex.zone
📍 Sevilla