Domain Expert – Video Games | Contractor | 8-Week Engagement | Worldwide Remote
Turing is looking for a seasoned Video Games Domain Expert to help evaluate and improve Large Language Models (LLMs). This is a unique opportunity to apply deep industry knowledge toward shaping the next generation of frontier AI systems at one of the world's leading AI research accelerators.
About Turing
Based in San Francisco, California, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI. Turing helps customers accelerate frontier research with high-quality data, advanced training pipelines, and top AI researchers specializing in coding, reasoning, STEM, multilinguality, multimodality, and agents.
Role Overview
As a Video Games Domain Expert, you will design challenging prompts, assess factual accuracy and reasoning quality, and identify knowledge gaps across game development, esports, platforms, game design, publishers, and communities.
Key Responsibilities
- Create advanced prompts covering game development, esports, platforms, game design, publishers, and communities.
- Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
- Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
- Develop benchmark datasets and adversarial test cases.
- Provide evidence-based feedback supported by reliable references.
- Collaborate with AI researchers to improve model performance.
- Maintain high annotation quality and thorough documentation.
Minimum Qualifications
- Master's degree or higher in a discipline related to Video Games.
- 3+ years of professional, research, or teaching experience in the field.
- Excellent written English and strong analytical skills.
- High attention to detail and commitment to accuracy.
Preferred Qualifications
- Experience with LLMs, Generative AI, prompt engineering, or AI evaluation.
- Published research, industry recognition, or teaching experience is a plus.
- Ability to work independently and deliver objective, evidence-backed reviews.
Engagement Details
- Commitment: 40 hours per week with at least 4 hours PST overlap required.
- Employment Type: Contractor assignment (no medical/paid leave benefits).
- Duration: 8-week contract.
