About The Role
What if your instinct for natural conversation could directly shape how AI communicates with millions of people? We're looking for Conversation Quality Analysts to evaluate AI-generated dialogues and help ensure they feel genuinely human — clear, helpful, and natural. This is a fully remote, adaptable contract role open to anyone with strong reading comprehension and a sharp ear for how people actually talk. No AI or linguistics background required — if you can tell the difference between a great conversation and an awkward one, you're already qualified.
* Organization: Alignerr
* Type: Hourly Contract
*
Location:
Remote
* Commitment: 10–40 hours/week What You’ll Do
* Read and evaluate AI-generated conversations across a wide range of topics and scenarios
* Assess responses for naturalness, helpfulness, tone, and contextual relevance
* Identify awkward phrasing, logical errors, irrelevant replies, or unnatural flow
* Compare multiple conversation paths and rank them by overall quality
* Submit structured, detailed evaluations using provided rating rubrics
* Work independently and asynchronously on your own schedule Who You Are
* Strong reading comprehension and an intuitive sense for natural language
* Able to assess conversation quality objectively and explain your reasoning clearly
* Detail-oriented and consistent — you apply the same standard across every evaluation
* Comfortable working through large volumes of dialogue efficiently
* Self-motivated and reliable when working independently
* No prior AI, linguistics, or NLP experience required Nice to Have
* Background in writing, editing, communications, or content review
* Experience with quality assurance, research, or critical analysis
* Familiarity with AI chatbots or conversational tools as an end user Why Join Us
* Work on cutting-edge AI projects alongside leading research labs
* Fully remote and flexible — work when and where it suits you
* Freelance autonomy with the structure of meaningful, task-based work
* Contribute directly to AI development that shapes how technology communicates with the world
* Potential for ongoing work and contract extension as new projects launch #J-18808-Ljbffr