AI Research Report Evaluator at Turing

AI Research Report Evaluator | Varies | Remote (US & Canada)

Turing is seeking graduate students and early-career professionals to evaluate AI-generated deep research reports across a wide range of domains. This is a fully remote, short-term contractor engagement ideal for those with strong analytical reading skills and a background in research or data quality work.

Role Overview

Evaluators will review AI-generated research reports using a structured rubric, providing numerical scores and written justifications across 10 quality dimensions. Reports span diverse fields including technology, healthcare, education, science, economics, social sciences, and the arts. Each report is reviewed in a single pass by one evaluator.

Day-to-Day Responsibilities

• Read and understand the research query and scope of each assigned report.
• Annotate reports using Adobe Acrobat — highlighting key evidence and flagging issues such as broken links, weak sources, or claim-source mismatches.
• Score each report across 10 dimensions on a 1–5 scale using a provided rubric.
• Write clear, evidence-based justifications for each rating.
• Submit completed evaluations via an online survey along with the annotated PDF.

Requirements

• Currently enrolled as a Master's or PhD candidate, or a professional with 1–3 years of relevant experience.
• Regularly reads research reports, white papers, or analytical documents.
• Strong English reading comprehension and written communication skills.
• Based in the USA or Canada.
• Comfortable using PDF annotation tools (Adobe Acrobat) and online survey platforms.
• Familiarity with one or more report domains: technology, healthcare, education, science, economics, social sciences, or related fields.
• Prior experience with quality evaluation, annotation, or data labeling is a plus.
• High attention to detail with the ability to provide structured, evidence-backed feedback.

Engagement Details

• Type: Freelance / Contractor (potential for full-time)
• Duration: 1 week per project, with possibility of extension based on performance
• Environment: Fully remote

Why Work with Turing?

• Contribute to cutting-edge AI research projects with leading LLM companies.
• Competitive compensation (varies by project).
• Opportunity for contract extensions based on performance.
• Flexible, fully remote work environment.

Note: Turing does not request confidential, proprietary, or trade secret information from any employer or university. Participation must not violate any NDA or employment agreement.