This job post has expired on April 26, 2026. It is likely that the position has already been filled.
Health & Medical Domain Expert at Mercor
posted 6 months agoHealth & Medical Domain Expert | $50–75/hr | Worldwide Remote
Mercor is partnering with a leading AI lab to bring on experienced health and medical professionals for an AI model evaluation project. In this role, you will assess the quality, accuracy, and safety of AI-generated responses in high-stakes medical and health contexts — directly contributing to more reliable and trustworthy AI systems.
Key Responsibilities
- Write realistic prompts that reflect how professionals and consumers seek health and medical guidance
- Evaluate AI-generated responses for factual accuracy, clinical correctness, and practical usefulness
- Identify fabricated claims, incorrect references, or misleading reasoning in model outputs
- Score and rank multiple model responses using structured rubrics across key dimensions
- Provide detailed written justifications supported by specific evidence for each evaluation
Ideal Qualifications
- Master's degree or higher in a health, medical, or closely related professional field
- Professional experience applying domain expertise in a practitioner or advisory capacity
- Familiarity with clinical guidelines, industry regulations, or healthcare standards
- Strong written communication and critical reasoning skills
Engagement Details
- Expected commitment: approximately 20 hours per week
- Fully remote and flexible scheduling
Application Process
Submit your resume to get started. Shortlisted candidates will be asked to complete a Model Response Evaluation assessment as part of the selection process.
How to apply for this role
- Upload your resume — keep it up-to-date and in English. Mercor will auto-fill your profile from it.
- Complete the AI interview — a 15-minute conversation about your experience. Be ready to discuss specific projects and challenges you've solved.
- Submit your application — only about 20% of applicants finish all the steps, so completing yours puts you well ahead.