LLM Language Evaluation Specialist – Spain
Descubra exactamente qué habilidades, experiencia y cualificaciones necesitará para tener éxito en este puesto antes de enviar su solicitud a continuación.
Project-based | Spain | RemoteWe are looking for
Afrikaans language specialists
to participate in a long-term
LLM Language Evaluation Project
focused on evaluating the quality and accuracy of AI-generated content.The project is expected to continue for
3+ months, with selected candidates first completing a trial evaluation before joining the production stage.
What You Will DoEvaluate AI/LLM-generated content in
Catalan
according to detailed project guidelines.Assess whether the content is accurate, natural, and linguistically appropriate.Identify and classify language-related issues, including:Mistranslation or inaccurate translationMissing or omitted contentIncorrect terminology or word usageSpelling, grammar, punctuation, and spacing errorsWord- or phrase-level issuesOther issues affecting the quality and readability of the contentIdentify abnormal cases, such as non-Slovak content, language identification errors, duplicate content, or content requiring rejection.Apply evaluation criteria consistently and provide structured evaluation results.Maintain high accuracy and attention to detail throughout the project.




RequirementsHigh proficiency in Catalan.Previous experience with
Large Language Model (LLM), AI evaluation, AI training, data annotation, localization, translation, or related projects is required.Strong understanding of Slovak grammar, vocabulary, terminology, and natural language usage.Strong ability to identify subtle language errors and distinguish between acceptable and incorrect expressions.Ability to understand and follow detailed evaluation guidelines.Strong attention to detail and execution ability.Comfortable working with structured digital documents and online tools.
Relevant professional or industry experience is a plus, but not mandatory.
Project InformationProject:
LLM Language EvaluationTarget Language:
CatalanDuration:
3+ monthsWork Mode:
Remote / Project-basedStart:
September 24, 2026.
Before starting project work, all selected candidates will go through a
1–5 day trial and training period
to familiarize themselves with the project guidelines and evaluation process.
The trial and training period is paid at the normal project rate, so candidates will be compensated for their time and completed work during this period. xghoner
Recruitment NoticeWe never charge candidates any fees at any stage of the recruitment or onboarding process.

📌 Llm Language Evaluation Specialist (Castro Caldelas)
🏢 Thoth AI
📍 Castro Caldelas