LLM Language Evaluation Specialist – SpainProject-based | Spain | Remote A continuación, encontrará un desglose completo de todo lo que se requiere de los posibles candidatos, así como la forma de presentar su candidatura. ¡Mucha suerte!

We are looking forCatalan language specialiststo participate in a long-termLLM Language Evaluation Projectfocused on evaluating the quality and accuracy of AI-generated content.

The project is expected to continue for3+ months , with selected candidates first completing a trial evaluation before joining the production stage.

What You Will Do

Evaluate AI/LLM-generated content inCatalanaccording to detailed project guidelines.

Assess whether the content is accurate, natural, and linguistically appropriate.

Identify and classify language-related issues, including:

Mistranslation or inaccurate translation

Missing or omitted content

Incorrect terminology or word usage

Spelling, grammar, punctuation, and spacing errors

Word- or phrase-level issues

Other issues affecting the quality and readability of the content

Identify abnormal cases, such as non-Slovak content, language identification errors, duplicate content, or content requiring rejection.

Apply evaluation criteria consistently and provide structured evaluation results.





Maintain high accuracy and attention to detail throughout the project.

Requirements

High proficiency in Catalan.

Previous experience withLarge Language Model (LLM), AI evaluation, AI training, data annotation, localization, translation, or related projects is required.

Strong understanding of Slovak grammar, vocabulary, terminology, and natural language usage.

Strong ability to identify subtle language errors and distinguish between acceptable and incorrect expressions.

Ability to understand and follow detailed evaluation guidelines.

Strong attention to detail and execution ability.

Comfortable working with structured digital documents and online tools.

Relevant professional or industry experience is a plus, but not mandatory.

Project Information

Project: LLM Language Evaluation

Target Language: Catalan

Duration:3+ months

Work Mode: Remote / Project-based

Start: September 24, 2026.Before starting project work, all selected candidates will go through a1��5 day trial and training periodto familiarize themselves with the project guidelines and evaluation process. xugodme The trial and training period is paid at the normal project rate , so candidates will be compensated for their time and completed work during this period.

📌 Llm language evaluation specialist (Arbo)
🏢 Thoth AI
📍 Arbo