Domain Expert Reviewer – Video Games at Turing

Video Games Domain Expert Reviewer | Contractor | 8-Week Engagement | Worldwide Remote

Turing, the world's leading AI research accelerator based in San Francisco, is looking for a Video Games Domain Expert Reviewer to support quality assurance on Large Language Model (LLM) evaluation projects. This is a short-term, high-impact contractor role ideal for professionals with deep expertise in the video games industry who want to contribute to cutting-edge AI development.

About Turing

Turing partners with frontier AI labs and global enterprises to accelerate AI research and deploy advanced AI systems. Our work spans high-quality data generation, advanced training pipelines, and domain-specific evaluation — powered by top researchers in coding, reasoning, STEM, multilinguality, and more.

Role Overview

As a Video Games Domain Expert Reviewer, you will evaluate domain-specific prompts and completed annotation tasks for accuracy, reasoning quality, and compliance with project guidelines. Your deep knowledge of the gaming landscape will be essential in maintaining the reliability and consistency of AI evaluation data.

Key Responsibilities

• Review and validate prompts related to game development, esports, gaming platforms, game design, publishers, genres, and gaming communities.
• Evaluate completed tasks for factual accuracy, reasoning quality, completeness, and guideline compliance.
• Identify factual inaccuracies, logical inconsistencies, hallucinations, and low-quality annotations.
• Ensure prompts are challenging, relevant, and aligned with project objectives.
• Provide clear, constructive, evidence-based feedback to contributors.
• Maintain consistency across reviews using established quality standards and rubrics.
• Escalate complex or ambiguous cases and document review findings.
• Collaborate with project managers and AI teams to improve evaluation workflows.

Minimum Qualifications

• Master's degree or higher in Video Games, Game Design, Interactive Media, Computer Science, or a closely related field.
• At least 3 years of professional, research, teaching, or industry experience in the video games domain.
• Prior experience reviewing, evaluating, or quality-checking technical or domain-specific content (preferred).
• Excellent written English communication and strong analytical skills.
• Sharp attention to detail with the ability to spot subtle factual and logical issues.

Preferred Qualifications

• Experience with AI-generated content review, LLM evaluations, prompt engineering, or annotation quality assurance.
• Familiarity with peer review, content moderation, or QA processes.
• Strong understanding of current gaming trends, esports, major publishers, platforms, and game development concepts.
• Ability to deliver objective, evidence-based feedback consistently.
• Comfortable working independently in a fast-paced, quality-focused environment.

Engagement Details

• Commitment: 40 hours per week with at least 4 hours PST overlap required
• Employment Type: Contractor (no medical or paid leave benefits)
• Duration: 8 weeks