Expert Prompt Curator – AI Evaluation at Mercor

Expert Prompt Curator | $70/hr | Remote

Join Mercor and a leading AI research lab to help shape the future of AI evaluation. As an Expert Prompt Curator, you will design and test challenging, domain-specific prompts that push the boundaries of current AI systems. This short-term, high-impact contract role is ideal for professionals with advanced expertise in STEM, law, finance, history, or related fields.

• Responsibilities:
  • Create original, expert-level prompts requiring advanced reasoning and tool use.
  • Ensure prompts are objective, self-contained, and yield clear answers.
  • Test prompts against advanced AI models and document outcomes.
  • Provide detailed reasoning steps and solutions for each prompt.
  • Classify prompts by subject domain for dataset organization.
  • Collaborate with reviewers for validation and refinement.
• Qualifications:
  • Advanced academic or professional expertise in a specialized subject area.
  • Experience designing high-difficulty questions or academic benchmarks preferred.
  • Strong attention to detail and ability to explain reasoning clearly.
  • Familiarity with AI models and their limitations is a plus.
• Opportunity:
  • Flexible, remote, and asynchronous work (~10–20 hours/week).
  • 2-month project with potential for extension.
  • Contribute to cutting-edge AI safety and evaluation research.
  • Competitive hourly compensation; independent contractor role.
• Application Process:
  • Submit your resume or CV highlighting your expertise.
  • Complete a brief questionnaire on your specialization.
  • Selected applicants may draft a short test prompt.

Mercor connects top experts with frontier AI projects, backed by leading investors and trusted by thousands of professionals worldwide.