Video Games Domain Expert Reviewer at Turing

Video Games Domain Expert Reviewer | Contractor | Remote (US Only)

Turing is seeking a knowledgeable Video Games Domain Expert Reviewer to support quality assurance for Large Language Model (LLM) evaluation projects. This is an 8-week contractor role requiring 40 hours per week with at least 4 hours of PST overlap. You will apply your deep expertise in the video games industry to ensure AI-generated content is accurate, well-reasoned, and aligned with project standards.

About Turing

Based in San Francisco, California, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing helps accelerate frontier research with high-quality data, advanced training pipelines, and top AI researchers — and helps enterprises transform AI from proof of concept into measurable business impact.

Key Responsibilities

• Review and validate domain-specific prompts covering game development, esports, gaming platforms, game design, publishers, genres, and gaming communities.
• Evaluate completed tasks for factual accuracy, reasoning quality, completeness, and compliance with project guidelines.
• Identify factual inaccuracies, logical inconsistencies, hallucinations, and low-quality annotations.
• Ensure prompts are challenging, relevant, and aligned with project objectives.
• Provide clear, constructive, and evidence-based feedback to contributors for quality improvement.
• Maintain consistency across reviews by following established quality standards and rubrics.
• Escalate ambiguous or complex cases and document review findings as needed.
• Collaborate with project managers and AI teams to continuously improve evaluation quality and workflows.

Minimum Qualifications

• Master's degree or higher in any field; degrees in Game Design, Game Development, Computer Science, Interactive Media, Digital Arts, Software Engineering, or Animation are preferred.
• Strong knowledge of the video games industry, including game development, design principles, platforms, genres, publishers, esports, and current trends.
• 3+ years of relevant professional experience in game development, QA, esports, gaming journalism, content creation, or a related field.
• Excellent written English, research, and analytical skills.
• Strong attention to detail with the ability to identify factual inconsistencies across a wide range of gaming topics.

Preferred Qualifications

• Experience reviewing AI-generated content, LLM evaluations, prompt engineering, or annotation quality.
• Familiarity with quality assurance processes, peer review, or content moderation.
• Ability to provide objective, evidence-based feedback while maintaining consistent quality standards.
• Comfortable working independently in a fast-paced, quality-focused environment.

Contract Details

• Commitment: 40 hours/week with at least 4 hours PST overlap
• Employment Type: Contractor (no medical/paid leave benefits)
• Duration: 8 weeks
• Location: Must be currently based in the United States