Legal Domain Expert (AI Evaluation) at Mercor

Legal Domain Expert | $50–75/hr | Worldwide Remote

Mercor is partnering with a leading AI research lab to bring on experienced legal professionals as contract evaluators for an AI model assessment project. In this role, you will help ensure AI-generated legal content is accurate, safe, and practically useful — directly improving the reliability of AI systems in high-stakes environments.

Key Responsibilities

• Write realistic prompts that reflect how legal professionals and consumers seek domain-specific guidance
• Evaluate AI-generated responses for factual accuracy, regulatory correctness, and practical usefulness
• Identify fabricated claims, incorrect legal references, or misleading reasoning in model outputs
• Score and rank multiple model responses using structured rubrics across key dimensions
• Provide detailed written justifications supported by specific evidence for each evaluation

Ideal Qualifications

• Master's degree or higher in Law or a relevant professional field (J.D. strongly preferred)
• Professional experience applying legal expertise in a practitioner or advisory capacity
• Familiarity with legal standards, regulations, and compliance frameworks
• Strong written communication and critical reasoning skills

Engagement Details

• Expected commitment: approximately 20 hours per week
• Fully remote and flexible scheduling

Application Process

Submit your resume to get started. Shortlisted candidates will be asked to complete a Model Response Evaluation assessment as part of the selection process.