This job post has expired on April 26, 2026. It is likely that the position has already been filled.
Legal Domain Expert (AI Evaluation) at Mercor
posted 6 months agoLegal Domain Expert | $50–75/hr | Worldwide Remote
Mercor is partnering with a leading AI research lab to bring on experienced legal professionals as contract evaluators for an AI model assessment project. In this role, you will help ensure AI-generated legal content is accurate, safe, and practically useful — directly improving the reliability of AI systems in high-stakes environments.
Key Responsibilities
- Write realistic prompts that reflect how legal professionals and consumers seek domain-specific guidance
- Evaluate AI-generated responses for factual accuracy, regulatory correctness, and practical usefulness
- Identify fabricated claims, incorrect legal references, or misleading reasoning in model outputs
- Score and rank multiple model responses using structured rubrics across key dimensions
- Provide detailed written justifications supported by specific evidence for each evaluation
Ideal Qualifications
- Master's degree or higher in Law or a relevant professional field (J.D. strongly preferred)
- Professional experience applying legal expertise in a practitioner or advisory capacity
- Familiarity with legal standards, regulations, and compliance frameworks
- Strong written communication and critical reasoning skills
Engagement Details
- Expected commitment: approximately 20 hours per week
- Fully remote and flexible scheduling
Application Process
Submit your resume to get started. Shortlisted candidates will be asked to complete a Model Response Evaluation assessment as part of the selection process.
How to apply for this role
- Upload your resume — keep it up-to-date and in English. Mercor will auto-fill your profile from it.
- Complete the AI interview — a 15-minute conversation about your experience. Be ready to discuss specific projects and challenges you've solved.
- Submit your application — only about 20% of applicants finish all the steps, so completing yours puts you well ahead.