Graduate-Level Science Evaluator at Mercor

Graduate-Level Science Evaluator

Hourly Contract | Remote Worldwide | $35-$60/hour

Mercor is looking for PhDs and advanced graduate students in biology, physics, chemistry, or related STEM fields to join a high-impact AI research partnership with a leading AI lab. Use your subject-matter expertise to rigorously benchmark and enhance large language models across the sciences, ensuring accuracy and depth in advanced scientific domains.

Key Responsibilities

• Evaluate scientific rigor, domain relevance, and technical accuracy of LLM-generated answers in biology, physics, and chemistry

• Review model outputs on topics such as molecular biology, genetics, quantum physics, mechanics, and physical chemistry

• Apply a structured 8–10 question rubric and provide concise written feedback for each assessment

• Identify logical gaps, factual inaccuracies, and strengths in scientific reasoning

• Work independently and asynchronously using easy-to-follow tools and guidelines

Ideal Qualifications

• PhD (or currently a PhD candidate) in Biology, Physics, Chemistry, or a related STEM discipline

• Deep familiarity with graduate-level science education and research problem solving

• Ability to critically assess scientific writing and analytical reasoning

• Excellent written communication and attention to detail

• Comfortable working independently and managing your own schedule in a remote environment

• Basic Python skills or willingness to learn (preferred but not required)

Job Details

• Part-time: 10–20 hours per week, flexible scheduling

• Fully remote and asynchronous – work from anywhere, on your own time

• Initial contract with potential for extension based on project needs

Compensation & Legal Details

• Hourly contractor role via Mercor

• Competitive rates from $35 to $60/hour based on domain and experience

• Weekly payments processed through Stripe Connect

Application Process

• Submit your application, resume, and brief details on your scientific background

• Complete a short structured interview if selected

Mercor values diversity and considers all qualified applicants without regard to legally protected characteristics. Reasonable accommodations available upon request.

Apply now to use your science expertise and help set new standards for AI model performance in the sciences.