Sales Domain Expert — Judge Calibration at Mercor

Sales Domain Expert — Judge Calibration Study | $90/hr | Worldwide Remote

Mercor is seeking experienced Sales professionals to participate in a structured judge-calibration study. In this short-term engagement, you will apply your domain expertise to evaluate realistic Sales tasks and assess AI-generated outputs — helping shape the quality and reliability of next-generation models.

What You'll Do

• Sign a Non-Disclosure Agreement (NDA) prior to receiving any study materials.
• Complete one realistic, scenario-based Sales task using provided source files.
• Review and rank model-generated outputs, assigning scores with evidence-based written rationales.
• Submit structured feedback on both the task itself and the overall study design.

Time Commitment

Approximately 13 hours, to be completed between September 12–15, 2026.

Who We're Looking For

• 5+ years of professional experience in Sales or a closely related field, preferably at a high-caliber organization.
• Experience at the manager, director, or principal level is strongly preferred — entry-level experience alone does not meet the bar.
• Fluent or native English speaker.
• Prior experience as a domain expert or evaluator is a plus.
• Open to applicants worldwide — no geographic restrictions apply.

Study Conditions & Eligibility

• No use of LLMs or AI assistants is permitted during the study — all work must reflect your own professional judgment.
• Individuals who have previously worked on Project Alchemy in any capacity, or who have accessed its source-world data, are not eligible to participate.