Rubrics Evaluator (Enterprise AI) at Mercor

Rubrics Evaluator (Enterprise AI) | $60–$85/hr | Worldwide Remote

Mercor is partnering with a leading AI lab to recruit experienced enterprise professionals for an AI evaluation and benchmarking project. In this role, you will assess the quality, accuracy, and reasoning of AI-generated responses across complex business and operational scenarios. This is an excellent opportunity for seasoned professionals in consulting, finance, law, operations, engineering, or related fields to contribute meaningfully to cutting-edge AI development.

Key Responsibilities

• Evaluate AI-generated outputs using structured rubrics and scoring frameworks
• Assess qualitative and quantitative reasoning across enterprise-focused scenarios
• Review business, operational, legal, financial, and strategic analyses for accuracy and clarity
• Identify gaps, inconsistencies, or weak reasoning in AI-generated content
• Provide clear written justification and feedback to support evaluation decisions

Ideal Qualifications

• Professional degree in business, law, finance, engineering, operations, or a related discipline
• 4+ years of experience in an enterprise environment
• Background in consulting, finance, legal operations, manufacturing, engineering, or corporate strategy
• Strong quantitative and qualitative reasoning skills
• Excellent written communication and attention to detail
• Ability to evaluate complex business scenarios independently
• Availability through Tuesday, May 19th

Application Process

• Ensure your Mercor profile reflects your most current work experience
• Selected applicants may be asked to complete a short evaluation exercise
• Qualified contributors will be contacted with project details and next steps