Posted over 30 days ago. Roles like this often stay open for a while, so it's still worth applying.
Inpatient Hospitalist MD — AI Evaluation at Mercor
posted 1 month agoInpatient Hospitalist (MD) | $170/hr | Remote in US
Mercor is seeking practicing Inpatient Hospitalists (MD) to collaborate with a leading healthcare AI partner developing advanced clinical documentation and decision-support tools. In this flexible, part-time role, you will leverage your active inpatient expertise to review, annotate, and evaluate hospital clinical documentation — directly influencing the accuracy, safety, and clinical utility of next-generation medical AI systems.
Key Responsibilities
Clinical Documentation Review
- Review inpatient documentation — including H&Ps, daily progress notes, and discharge summaries — for accuracy, completeness, and clinical soundness.
- Evaluate AI-generated inpatient notes and summaries against the standards of a practicing hospitalist.
Annotation & Structured Feedback
- Annotate inpatient encounter data in accordance with detailed guidelines.
- Identify and flag omissions, hallucinations, clinical inaccuracies, and documentation gaps in AI-generated output.
- Provide clear, structured written feedback actionable by engineering and product teams.
Knowledge Contribution
- Contribute expert input on annotation guidelines, documentation standards, and edge-case definitions.
- Help refine guidelines by raising clarifying questions where guidance is ambiguous.
Required Qualifications
- MD in hospitalist medicine or internal medicine with 2+ years post-residency experience.
- Current, active inpatient practice in the United States.
- Hands-on experience writing and reading at least one of the following: H&Ps, progress notes, or discharge summaries.
Preferred Qualifications
- 5+ years of post-residency experience.
- Familiarity with Epic EHR.
- Prior experience in AI/ML annotation or model evaluation with strong performance reviews.
Work Arrangement
This is a remote, part-time contractor role with flexible scheduling designed to fit around an active clinical practice. Compensation is $170/hr.
How to apply for this role
- Upload your resume — keep it up-to-date and in English. Mercor will auto-fill your profile from it.
- Complete the AI interview — a 15-minute conversation about your experience. Be ready to discuss specific projects and challenges you've solved.
- Submit your application — only about 20% of applicants finish all the steps, so completing yours puts you well ahead.