STEM PhD - AI Subject Matter Expert at Mercor

AI Research Evaluator | $105/hr | Worldwide Remote

Mercor is partnering with a leading research organization to engage independent AI and machine learning experts for a specialized study. This short-term, flexible contract involves evaluating the quality, novelty, and methodological rigor of modern ML research through paper analysis, code inspection, and credibility assessment.

Key Responsibilities

• Critically review machine learning papers for methodological soundness, novelty, and clarity
• Inspect Python source code and experimental logs to validate reported metrics against underlying data
• Conduct literature reviews using Google Scholar or Semantic Scholar to identify prior work, detect plagiarism, and assess research originality
• Provide structured feedback on research quality assessments and potential ethical or safety-related concerns
• Submit non-identifying background details to establish evaluator credibility for the study

Ideal Qualifications

• Strong academic or professional background in artificial intelligence, machine learning, or related research domains
• Experience interpreting and analyzing ML papers; familiarity with top-tier venues (NeurIPS, ICLR, ICML) preferred but not required
• Ability to read and evaluate Python code, experimental pipelines, and quantitative logs
• Demonstrated experience with academic literature review tools
• Doctoral students, industry researchers, and published authors strongly encouraged to apply
• High attention to detail and ability to assess complex technical arguments

Contract Details

Payments are issued regularly based on completed work via Mercor's platform. Start date: Immediate

Application Process

• Submit your resume or CV to begin
• Complete a brief form outlining your technical background and relevant publications
• Additional screening questions or sample evaluations may be requested to confirm expertise

About Mercor

Mercor is a talent marketplace connecting top experts with leading AI labs and research organizations. Our investors include Benchmark, General Catalyst, Adam D'Angelo, Larry Summers, and Jack Dorsey. Thousands of professionals across research, engineering, law, and creative domains partner through Mercor to support frontier AI projects.