AI Conversation Evaluator & Rewriter at Mercor

AI Conversation Evaluator | $30–35/hr | Remote Worldwide

Mercor is seeking highly skilled Generalists (Bachelor's degree minimum) to support a fast-moving project with one of the world's leading AI labs. This initiative focuses on improving AI systems designed for therapeutic-style conversations by evaluating, comparing, and refining model-generated responses.

What You'll Do:

• Review pairs of AI-generated replies in therapeutic conversation contexts
• Assess responses against structured criteria including empathy, emotional insight, communication quality, and appropriateness for supportive dialogue
• Produce clear, improved rewrites that better meet project standards when needed
• Support research teams in strengthening safe, supportive, and human-aligned AI behavior in mental-health-oriented conversation settings

Requirements:

• Bachelor's degree (minimum)
• Strong analytical and writing skills
• Ability to evaluate nuanced conversational responses
• Available to begin immediately following mandatory onboarding session

Important: This project has an accelerated timeline and requires contributors who can start right away. Your work will directly impact the development of AI systems designed to provide supportive, empathetic conversations.