Behavioral Health Expert, AI Safety at Mercor
posted 2 hours agoBehavioral Health Expert | $45-70/hr | Remote (US) | Part Time
Review and evaluate how an AI lab's models handle sensitive, everyday conversations, and help researchers define what a good response looks like.
What the work involves
- Evaluate conversations between users and AI models on topics like relationship and family advice, emotional wellbeing, spiritual questions and unconventional or unfounded beliefs, assessing whether responses are neutral, appropriate and safe.
- Identify patterns of concern, such as excessive agreement, taking sides, reinforcing distorted beliefs, moralizing or overstepping into clinical advice, and document them with clear written rationale.
- Develop rubrics, guidelines and reference responses grounded in counseling and behavioral health practice.
- Design test scenarios probing how models handle sensitive but non-crisis topics.
- Collaborate with researchers and fellow experts to keep evaluation standards consistent and calibrated.
Who it's for
- A degree in psychology, counseling, social work, behavioral health, behavioral science, human services or a closely related field, or equivalent professional experience.
- 3+ years supporting people in a mental health, counseling or social services setting (e.g. therapist, counselor, clinical social worker, psychologist, psychiatric nurse, case manager, crisis counselor, peer support specialist). Clinical licensure (LMFT, LCSW, LPC, LMHC, PsyD or PhD) is valued but not required.
- Ability to remain neutral and nonjudgmental across diverse perspectives and belief systems, and to explain the reasoning behind a professional judgment.
- Familiarity with concepts such as sycophancy, cognitive distortions, healthy boundaries and client-centered approaches like motivational interviewing.
- Strong written communication skills, with precise, well-structured feedback.
Nice to have: background in AI safety, applied ethics, trust and safety or content policy; couples/family counseling experience; familiarity with spiritual care or the psychology of misinformation; prior experience evaluating or red-teaming AI systems. You don't need all of these to apply.
Pay and schedule
- $45-70/hr, part-time.
- At least 20 hours/week during weekdays, with the option to increase to up to 40 hours/week.
Where applicants can be
This is a remote role based in the United States. It is a W-2 employment position with Cincinnatus LLC, a staffing company that serves as employer of record (payroll, benefits and compliance) and places employees within client teams, with the opportunity to be placed at a leading AI lab as part of their extended workforce.
How to apply for this role
- Upload your resume — keep it up-to-date and in English. Mercor will auto-fill your profile from it.
- Complete the AI interview — a 15-minute conversation about your experience. Be ready to discuss specific projects and challenges you've solved.
- Submit your application — only about 20% of applicants finish all the steps, so completing yours puts you well ahead.