Posted over 30 days ago. Roles like this often stay open for a while, so it's still worth applying.
Domain Expert Reviewer – Geography at Turing
posted 3 months agoGeography Domain Expert Reviewer | Contractor | 8-Week Engagement | Worldwide Remote
Turing is seeking a highly qualified Geography Domain Expert Reviewer to support quality assurance for Large Language Model (LLM) evaluation projects. In this role, you will review and validate geography-related prompts and annotations, ensuring factual accuracy, reasoning quality, and adherence to project guidelines. Your expertise will directly contribute to the reliability and consistency of AI training data.
About Turing:
Based in San Francisco, California, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing specializes in high-quality data, advanced training pipelines, and top-tier AI research across coding, reasoning, STEM, multilinguality, multimodality, and agents.
Key Responsibilities:
- Review and validate domain-specific prompts covering physical geography, human geography, countries, capitals, climate, geopolitics, demographics, maps, environmental systems, and related topics.
- Evaluate completed tasks for factual accuracy, reasoning quality, completeness, and compliance with project guidelines.
- Identify factual inaccuracies, logical inconsistencies, hallucinations, outdated information, and low-quality annotations.
- Ensure prompts are challenging, relevant, and aligned with project objectives.
- Provide clear, constructive, and evidence-based feedback to contributors to improve task quality.
- Maintain consistency across reviews by following established quality standards and guidelines.
- Escalate ambiguous or complex cases and document review findings as needed.
- Collaborate with project managers and AI teams to continuously improve evaluation quality and review processes.
Minimum Qualifications:
- Master's degree or higher in Geography, Geoscience, Environmental Science, GIS, Urban Planning, or a closely related discipline.
- Minimum 3 years of professional, research, teaching, or industry experience in the geography domain.
- Prior experience reviewing, evaluating, editing, or quality-checking domain-specific content is preferred.
- Excellent written English communication and strong analytical skills.
- High attention to detail with the ability to identify factual, logical, and contextual errors.
Engagement Details:
- Hours: 40 hours per week with at least 4 hours PST overlap required
- Employment Type: Contractor assignment (no medical or paid leave benefits)
- Duration: 8-week contract