ppbPosition: /b LLM AI Quality Analyst (Spanish) /p pbType: /b Short-Term Contract /p pbCompensation: /b $11 per hour /p pbLocation: /b Remote /p pbCommitment: /b Part-time (30 40 hrs/week) /p h3Role Responsibilities /h3 ul liEvaluate a personalization feature for Gemini /li liDesign and execute multi-turn conversational prompts that require the AI to utilize personal information and experiences /li liAssess how effectively the model uses past conversations and activity to generate relevant and helpful responses /li liEvaluate model responses based on intent and appropriate personalization /li liAnalyze responses for grounding issues, including flawed inferences or hallucinations /li liAssess integration quality to ensure personal data is incorporated naturally into responses /li liPerform side-by-side evaluations and stack-rank model responses based on helpfulness and naturalness /li liWrite clear rationales referencing specific conversation turns /li liExtract and verify debug information to confirm correct use of summaries and data sources /li liMaintain data hygiene by deleting evaluation conversations after completion /li /ul h3Requirements /h3 ul liExperience in data annotation, AI quality evaluation, content moderation, or related roles /li liStrong Spanish proficiency (reading and writing) /li liWillingness to use a primary personal Google account and enable personal data sources for assessment /li liStrong analytical thinking and attention to detail /li liExperience with creative prompt engineering and personalization concepts /li liAbility to provide structured feedback and clear written explanations /li liAbility to work independently in a remote environment /li /ul h3Application Process /h3 ul liApply/Easy Apply and check email for application form /li liFill Google form /li liAssessment Link (After shortlisting to be completed within 24 hours) /li /ul /p #J-18808-Ljbffr

📌 Generative AI Evaluator (Spanish) | $11/hr Remote (España)
🏢 Crossing Hurdles
📍 España