Medical Expert - AI Evaluation at Mercor

Medical Expert - AI Evaluation | $80–100/hr | Worldwide Remote

Mercor is seeking highly qualified Medical Experts with strong clinical knowledge and excellent analytical skills to support a high-impact AI research initiative in partnership with a leading AI lab. In this role, you will evaluate and audit AI-generated medical outputs across a wide range of clinical and scientific tasks, ensuring accuracy, safety, and adherence to medical standards.

Key Responsibilities

• Review and audit AI-generated medical content, including clinical explanations, differential diagnoses, treatment recommendations, research summaries, and patient-facing materials
• Evaluate medical text quality using structured rubrics (8–10 criteria), focusing on accuracy, evidence alignment, clarity, and risk/safety considerations
• Verify correctness of clinical reasoning, identifying logical gaps, unsafe recommendations, or unsupported claims
• Assess adherence to medical guidelines, best practices, and standard terminology
• Identify errors related to medical facts, pathophysiology, pharmacology, contraindications, or misinterpretation of clinical data
• Provide clear, concise written feedback to justify evaluation decisions
• Work independently and asynchronously using provided tools and workflows

Qualifications

• Advanced medical training (MD, DO, RN, PA, NP, clinical researcher, or equivalent background)
• Strong understanding of clinical reasoning, diagnostic process, and evidence-based practice
• Experience in clinical writing or reviewing, medical education or exam preparation content, research interpretation and summarization, or healthcare quality review
• Exceptional attention to detail and ability to follow complex guidelines
• Ability to work independently in a remote environment

Role Details

• Part-time: 30–40 hours per week
• Fully remote and asynchronous
• Flexible scheduling
• Contractor role via Mercor
• Weekly payments through Stripe Connect

About Mercor

Mercor is a San Francisco–based company connecting top professionals to cutting-edge AI initiatives. Our investors include Benchmark, General Catalyst, Adam D'Angelo, Larry Summers, and Jack Dorsey. We partner with leading AI labs to accelerate innovation through high-quality human evaluation.