Position:LLM AI Quality Analyst (Spanish)La información a continuación detalla los requisitos del puesto, la experiencia esperada del candidato y las cualificaciones correspondientes.Type:Short-Term ContractCompensation:$11 per hourLocation:RemoteCommitment:Part-time (30 40 hrs/week)Role ResponsibilitiesEvaluate a personalization feature for GeminiDesign and execute multi-turn conversational prompts that require the AI to utilize personal information and experiencesAssess how effectively the model uses past conversations and activity to generate relevant and helpful responsesEvaluate model responses based on intent and appropriate personalizationAnalyze responses for grounding issues,



including flawed inferences or hallucinationsAssess integration quality to ensure personal data is incorporated naturally into responsesPerform side-by-side evaluations and stack-rank model responses based on helpfulness and naturalnessWrite clear rationales referencing specific conversation turnsExtract and verify debug information to confirm correct use of summaries and data sourcesMaintain data hygiene by deleting evaluation conversations after completionRequirementsExperience in data annotation, AI quality evaluation, content moderation, or related rolesStrong Spanish proficiency (reading and writing)Willingness to use a primary personal Google account and enable personal data sources for assessmentStrong analytical thinking and attention to detailExperience xcskxlj with creative prompt engineering and personalization conceptsAbility to provide structured feedback and clear written explanationsAbility to work independently in a remote environmentApplication ProcessApply/Easy Apply and check email for application formFill Google formAssessment Link (After shortlisting to be completed within 24 hours)

📌 Generative Ai Evaluator (Spanish) | $11/Hr Remote (Madrid)
🏢 Crossing Hurdles
📍 Madrid