This job post has expired on January 12, 2026. It is likely that the position has already been filled.
Medical Expert - AI Evaluation at Mercor
posted 10 months agoMedical Expert - AI Evaluation | $80–100/hr | Worldwide Remote
Mercor is seeking highly qualified Medical Experts with strong clinical knowledge and excellent analytical skills to support a high-impact AI research initiative in partnership with a leading AI lab. In this role, you will evaluate and audit AI-generated medical outputs across a wide range of clinical and scientific tasks, ensuring accuracy, safety, and adherence to medical standards.
Key Responsibilities
- Review and audit AI-generated medical content, including clinical explanations, differential diagnoses, treatment recommendations, research summaries, and patient-facing materials
- Evaluate medical text quality using structured rubrics (8–10 criteria), focusing on accuracy, evidence alignment, clarity, and risk/safety considerations
- Verify correctness of clinical reasoning, identifying logical gaps, unsafe recommendations, or unsupported claims
- Assess adherence to medical guidelines, best practices, and standard terminology
- Identify errors related to medical facts, pathophysiology, pharmacology, contraindications, or misinterpretation of clinical data
- Provide clear, concise written feedback to justify evaluation decisions
- Work independently and asynchronously using provided tools and workflows
Qualifications
- Advanced medical training (MD, DO, RN, PA, NP, clinical researcher, or equivalent background)
- Strong understanding of clinical reasoning, diagnostic process, and evidence-based practice
- Experience in clinical writing or reviewing, medical education or exam preparation content, research interpretation and summarization, or healthcare quality review
- Exceptional attention to detail and ability to follow complex guidelines
- Ability to work independently in a remote environment
Role Details
- Part-time: 30–40 hours per week
- Fully remote and asynchronous
- Flexible scheduling
- Contractor role via Mercor
- Weekly payments through Stripe Connect
About Mercor
Mercor is a San Francisco–based company connecting top professionals to cutting-edge AI initiatives. Our investors include Benchmark, General Catalyst, Adam D'Angelo, Larry Summers, and Jack Dorsey. We partner with leading AI labs to accelerate innovation through high-quality human evaluation.
How to apply for this role
- Upload your resume — keep it up-to-date and in English. Mercor will auto-fill your profile from it.
- Complete the AI interview — a 15-minute conversation about your experience. Be ready to discuss specific projects and challenges you've solved.
- Submit your application — only about 20% of applicants finish all the steps, so completing yours puts you well ahead.