ph3Remote Data Annotation Jobs Madrid (Full-Time, Remote) /h3pJoin production-grade AI/ML training workflows by labeling and evaluating data used to improve model performance across NLP, computer vision, and content safety systems. You will follow strict rubrics and maintain strong annotation guidelines compliance to protect training data quality for LLM training pipelines. /ph3Key Responsibilities /h3ulliExecute structured annotation tasks: classification, ranking, span labeling, and named entity recognition (NER) /liliPerform LLM evaluation and prompt evaluation (helpfulness, factuality, groundedness, instruction-following) /liliContribute to RLHF workflows via preference judgments, rationale writing, and comparative response evaluation /liliRun QA evaluation through self-checks, peer reviews, and audit responses /liliDocument edge cases, track error patterns,



and propose guideline clarifications to reduce variance /li /ulh3Projects and Task Types /h3ulliMultilingual NER and text labeling /liliContent safety labeling aligned to policy taxonomies /liliComputer vision annotation (bounding boxes, segmentation, image-text alignment) as needed /liliCalibration sets and inter-review agreement improvement activities /li /ulh3Required Qualifications /h3ulliExperience with guideline-based labeling, evaluation frameworks, QA, data operations, or similar rubric-driven work /liliAbility to interpret complex guidelines and apply consistent decisions at scale /liliComfort with web-based annotation tools, task queues, and documentation of edge cases /liliStrong written English for rationale-based RLHF comparisons and clear communication /li /ulh3Benefits /h3ulliCompetitive hourly rate: $30–$50/hr /liliFully remote, full-time structured workflows with calibration and quality checkpoints /liliWork on real-world LLM evaluation and multimodal annotation programs /li /ul /p #J-18808-Ljbffr

📌 Remote Data Annotation Jobs Madrid
🏢 Rex.zone
📍 Madrid