ph3About The Role /h3pAs a Remote Data Annotator, you will perform end-to-end data annotation and AI/ML evaluation work that powers training datasets for NLP, computer vision, and large language model evaluation. You will follow detailed annotation guidelines, document edge cases, and contribute to training data quality initiatives that improve model performance. /ph3What You Will Do /h3ulliCreate and validate labels for text and image data /liliPerform named entity recognition and taxonomy tagging /liliRun content safety labeling using policy-based classification /liliConduct prompt evaluation and response grading for LLM behavior /liliExecute RLHF ranking and pairwise comparisons /liliComplete QA checks, audits,



and improve inter-annotator agreement /liliWrite clear rationales for complex or subjective judgments /liliCollaborate asynchronously with distributed teams and project leads /li /ulh3Required Qualifications /h3ulliMid-to-senior experience in data annotation, data labeling, or QA evaluation /liliStrong written reasoning and ability to maintain guideline adherence /liliFamiliarity with LLM concepts, RLHF-style ranking, and prompt evaluation /liliComfort using labeling tools, spreadsheets, and structured workflows /li /ulh3Quality Standards /h3pSuccess is measured by audit scores, guideline adherence, low rework rates, strong inter-annotator agreement, consistent throughput, and clear rationales that improve training data quality. /ppThis is a Remote, FULL_TIME role. /p /p #J-18808-Ljbffr

📌 Remote Data Annotator Jobs Madrid
🏢 Rex.zone
📍 Madrid