About The Role
As a Remote Data Annotator, you will perform end-to-end data annotation and AI/ML evaluation work that powers training datasets for NLP, computer vision, and large language model evaluation. You will follow detailed annotation guidelines, document edge cases, and contribute to training data quality initiatives that improve model performance.What You Will Do
Create and validate labels for text and image dataPerform named entity recognition and taxonomy taggingRun content safety labeling using policy-based classificationConduct prompt evaluation and response grading for LLM behaviorExecute RLHF ranking and pairwise comparisonsComplete QA checks, audits,



and improve inter-annotator agreementWrite clear rationales for complex or subjective judgmentsCollaborate asynchronously with distributed teams and project leadsRequired Qualifications
Mid-to-senior experience in data annotation, data labeling, or QA evaluationStrong written reasoning and ability to maintain guideline adherenceFamiliarity with LLM concepts, RLHF-style ranking, and prompt evaluationComfort using labeling tools, spreadsheets, and structured workflowsQuality Standards
Success is measured by audit scores, guideline adherence, low rework rates, strong inter-annotator agreement, consistent throughput, and clear rationales that improve training data quality.This is a Remote, FULL_TIME role.
#J-18808-Ljbffr

📌 Catalan Voice Data Annotator – Remote - Remote (Alcobendas)
🏢 LxT AI
📍 Alcobendas