Conversation Quality Analyst (AI Training)

About The Role

What if your instinct for natural conversation could directly shape how AI communicates with millions of people? We're looking for Conversation Quality Analysts to evaluate AI-generated dialogues and help ensure they feel genuinely human — clear, helpful, and natural.

This is a fully remote, flexible contract role open to anyone with strong reading comprehension and a sharp ear for how people actually talk. No AI or linguistics background required — if you can tell the difference between a great conversation and an awkward one, you're already qualified.

Organization: Alignerr
Type: Hourly Contract
Location: Remote
Commitment: 10–40 hours/week

What You'll Do

Read and evaluate AI-generated conversations across a wide range of topics and scenarios
Assess responses for naturalness, helpfulness, tone, and contextual relevance
Identify awkward phrasing, logical errors, irrelevant replies, or unnatural flow
Compare multiple conversation paths and rank them by overall quality
Submit structured,



detailed evaluations using provided rating rubrics
Work independently and asynchronously on your own schedule

Who You Are

Strong reading comprehension and an intuitive sense for natural language
Able to assess conversation quality objectively and explain your reasoning clearly
Detail-oriented and consistent — you apply the same standard across every evaluation
Comfortable working through large volumes of dialogue efficiently
Self-motivated and reliable when working independently
No prior AI, linguistics, or NLP experience required

Nice to Have

Background in writing, editing, communications, or content review
Experience with quality assurance, research, or critical analysis
Familiarity with AI chatbots or conversational tools as an end user

Why Join Us

Work on cutting-edge AI projects alongside leading research labs
Fully remote and versátil — work when and where it suits you
Freelance autonomy with the structure of

📌 Conversation Quality Analyst (España)
🏢 Alignerr
📍 España