Domain Expert Reviewer – History at Turing

Domain Expert Reviewer – History | Contractor | 8-Week Engagement | Worldwide Remote

Turing is seeking a highly qualified History Domain Expert Reviewer to support quality assurance for Large Language Model (LLM) evaluation projects. In this role, you will review and validate domain-specific historical content, assess task accuracy, and provide actionable feedback to uphold rigorous annotation standards. This is a fully remote contractor engagement requiring 40 hours per week with at least 4 hours of PST overlap.

About Turing

Based in San Francisco, California, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing helps accelerate frontier research with high-quality data, advanced training pipelines, and top AI researchers — and applies that expertise to help enterprises transform AI from proof of concept into measurable business impact.

Key Responsibilities

• Review and validate domain-specific prompts spanning ancient, medieval, modern, and contemporary history, including civilizations, political history, military history, archaeology, and historiography.
• Evaluate completed tasks for factual accuracy, reasoning quality, completeness, and compliance with project guidelines.
• Identify factual inaccuracies, logical inconsistencies, hallucinations, outdated information, and low-quality annotations.
• Ensure prompts are challenging, relevant, and aligned with project objectives.
• Provide clear, constructive, and evidence-based feedback to contributors to improve overall task quality.
• Maintain consistency across reviews by adhering to established quality standards and review guidelines.
• Escalate ambiguous or complex cases as needed and document review findings thoroughly.
• Collaborate with project managers and AI teams to continuously refine evaluation quality and review processes.

Minimum Qualifications

• Master's degree or higher in History, Archaeology, Historical Studies, Political History, World History, or a closely related discipline.
• Minimum 3 years of professional, research, teaching, or industry experience in the history domain.
• Prior experience reviewing, evaluating, editing, or quality-checking domain-specific content is preferred.
• Excellent written English communication and strong analytical skills.
• Sharp attention to detail with the ability to identify factual, logical, and contextual errors.

Engagement Details

• Hours: 40 hours per week with at least 4 hours PST overlap
• Employment Type: Contractor assignment (no medical or paid leave benefits)
• Duration: 8 weeks