Domain Expert Reviewer – Sports | Contractor | Remote | 8-Week Engagement
Turing is seeking a highly qualified Sports Domain Expert Reviewer to support quality assurance for Large Language Model (LLM) evaluation projects. This is a remote contractor role requiring 40 hours per week with at least 4 hours of PST overlap, running for an 8-week duration.
About Turing
Based in San Francisco, California, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing accelerates frontier research with high-quality data, advanced training pipelines, and top AI researchers specializing in coding, reasoning, STEM, multilinguality, multimodality, and agents.
Role Overview
In this role, you will review domain-specific prompts, evaluate completed annotation tasks for accuracy and quality, and provide actionable feedback to maintain high standards across AI evaluation datasets. Your deep expertise in sports will directly contribute to the reliability and consistency of AI training data.
Key Responsibilities
- Review and validate domain-specific prompts covering global sports, leagues, athletes, tournaments, rules, statistics, sports history, and analytics.
- Evaluate completed tasks for factual accuracy, reasoning quality, completeness, and guideline compliance.
- Identify factual inaccuracies, logical inconsistencies, hallucinations, outdated information, and low-quality annotations.
- Ensure prompts are challenging, relevant, and aligned with project objectives.
- Provide clear, constructive, and evidence-based feedback to contributors.
- Maintain consistency across reviews by adhering to established quality standards.
- Escalate ambiguous or complex cases and document review findings as needed.
- Collaborate with project managers and AI teams to continuously improve evaluation quality.
Minimum Qualifications
- Master's degree or higher in Sports Management, Sports Science, Kinesiology, Exercise Science, Physical Education, or a closely related field.
- Minimum 3 years of professional, research, teaching, or industry experience in the sports domain.
- Prior experience reviewing, evaluating, editing, or quality-checking domain-specific content is preferred.
- Excellent written English communication and strong analytical skills.
- Sharp attention to detail with the ability to identify factual, logical, and contextual errors.
Preferred Qualifications
- Experience reviewing AI-generated content, LLM evaluations, prompt engineering, or annotation quality.
- Familiarity with quality assurance, editorial review, or technical content evaluation workflows.
- Ability to provide objective, evidence-based feedback while maintaining consistent quality standards.
- Comfortable working independently in a fast-paced, quality-focused environment.
Engagement Details
- Hours: 40 hours/week with at least 4 hours PST overlap
- Employment Type: Contractor (no medical/paid leave benefits)
- Duration: 8 weeks
