Posted over 30 days ago. Roles like this often stay open for a while, so it's still worth applying.
STEM PhD - AI Subject Matter Expert at Mercor
posted 10 months agoAI Research Evaluator | $105/hr | Worldwide Remote
Mercor is partnering with a leading research organization to engage independent AI and machine learning experts for a specialized study. This short-term, flexible contract involves evaluating the quality, novelty, and methodological rigor of modern ML research through paper analysis, code inspection, and credibility assessment.
Key Responsibilities
- Critically review machine learning papers for methodological soundness, novelty, and clarity
- Inspect Python source code and experimental logs to validate reported metrics against underlying data
- Conduct literature reviews using Google Scholar or Semantic Scholar to identify prior work, detect plagiarism, and assess research originality
- Provide structured feedback on research quality assessments and potential ethical or safety-related concerns
- Submit non-identifying background details to establish evaluator credibility for the study
Ideal Qualifications
- Strong academic or professional background in artificial intelligence, machine learning, or related research domains
- Experience interpreting and analyzing ML papers; familiarity with top-tier venues (NeurIPS, ICLR, ICML) preferred but not required
- Ability to read and evaluate Python code, experimental pipelines, and quantitative logs
- Demonstrated experience with academic literature review tools
- Doctoral students, industry researchers, and published authors strongly encouraged to apply
- High attention to detail and ability to assess complex technical arguments
Contract Details
Payments are issued regularly based on completed work via Mercor's platform. Start date: Immediate
Application Process
- Submit your resume or CV to begin
- Complete a brief form outlining your technical background and relevant publications
- Additional screening questions or sample evaluations may be requested to confirm expertise
About Mercor
Mercor is a talent marketplace connecting top experts with leading AI labs and research organizations. Our investors include Benchmark, General Catalyst, Adam D'Angelo, Larry Summers, and Jack Dorsey. Thousands of professionals across research, engineering, law, and creative domains partner through Mercor to support frontier AI projects.
How to apply for this role
- Upload your resume — keep it up-to-date and in English. Mercor will auto-fill your profile from it.
- Complete the AI interview — a 15-minute conversation about your experience. Be ready to discuss specific projects and challenges you've solved.
- Submit your application — only about 20% of applicants finish all the steps, so completing yours puts you well ahead.