Benture logo

This job post has expired on September 20, 2025. It is likely that the position has already been filled.

Mercor logo

Expert Prompt Curator – AI Evaluation at Mercor

posted 7 months ago
mercor.com Contractor remote 70/hr 627 views

Expert Prompt Curator | $70/hr | Remote

Join Mercor and a leading AI research lab to help shape the future of AI evaluation. As an Expert Prompt Curator, you will design and test challenging, domain-specific prompts that push the boundaries of current AI systems. This short-term, high-impact contract role is ideal for professionals with advanced expertise in STEM, law, finance, history, or related fields.

  • Responsibilities:
    • Create original, expert-level prompts requiring advanced reasoning and tool use.
    • Ensure prompts are objective, self-contained, and yield clear answers.
    • Test prompts against advanced AI models and document outcomes.
    • Provide detailed reasoning steps and solutions for each prompt.
    • Classify prompts by subject domain for dataset organization.
    • Collaborate with reviewers for validation and refinement.
  • Qualifications:
    • Advanced academic or professional expertise in a specialized subject area.
    • Experience designing high-difficulty questions or academic benchmarks preferred.
    • Strong attention to detail and ability to explain reasoning clearly.
    • Familiarity with AI models and their limitations is a plus.
  • Opportunity:
    • Flexible, remote, and asynchronous work (~10–20 hours/week).
    • 2-month project with potential for extension.
    • Contribute to cutting-edge AI safety and evaluation research.
    • Competitive hourly compensation; independent contractor role.
  • Application Process:
    • Submit your resume or CV highlighting your expertise.
    • Complete a brief questionnaire on your specialization.
    • Selected applicants may draft a short test prompt.

Mercor connects top experts with frontier AI projects, backed by leading investors and trusted by thousands of professionals worldwide.

How to apply for this role
  • Upload your resume — keep it up-to-date and in English. Mercor will auto-fill your profile from it.
  • Complete the AI interview — a 15-minute conversation about your experience. Be ready to discuss specific projects and challenges you've solved.
  • Submit your application — only about 20% of applicants finish all the steps, so completing yours puts you well ahead.
Benture is an independent job board and is not affiliated with Mercor.

Related Jobs

Benture logo
See All Jobs