Domain Expert Reviewer – Politics at Turing

Domain Expert Reviewer – Politics | Contractor (40 hrs/week) | Worldwide Remote

Turing is seeking a highly qualified Politics Domain Reviewer to support quality assurance for Large Language Model (LLM) evaluation projects. This is an 8-week contractor role requiring 40 hours per week with at least 4 hours of PST overlap. Your expertise in political science will directly shape the reliability and accuracy of AI-generated content across a wide range of political topics.

About Turing

Based in San Francisco, California, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing accelerates frontier research with high-quality data, advanced training pipelines, and top AI researchers specializing in coding, reasoning, STEM, multilinguality, multimodality, and agents.

Key Responsibilities

• Review and validate domain-specific prompts covering political science, governance, elections, public policy, international relations, and political systems.
• Evaluate completed tasks for factual accuracy, reasoning quality, completeness, neutrality, and compliance with project guidelines.
• Identify factual inaccuracies, logical inconsistencies, hallucinations, outdated information, bias, and low-quality annotations.
• Ensure prompts are challenging, relevant, and aligned with project objectives.
• Provide clear, constructive, and evidence-based feedback to contributors to improve task quality.
• Maintain consistency across reviews by following established quality standards and guidelines.
• Escalate ambiguous, sensitive, or complex cases and document review findings as needed.
• Collaborate with project managers and AI teams to continuously improve evaluation quality and review processes.

Minimum Qualifications

• Master's degree or higher in Political Science, Public Policy, International Relations, Government, Public Administration, or a closely related discipline.
• Minimum 3 years of professional, research, teaching, or policy-related experience in the politics domain.
• Prior experience reviewing, evaluating, editing, or quality-checking domain-specific content is preferred.
• Excellent written English communication and strong analytical skills.
• Sharp attention to detail with the ability to identify factual, logical, contextual, and neutrality-related issues.

Preferred Qualifications

• Experience reviewing AI-generated content, LLM evaluations, prompt engineering, or annotation quality.
• Familiarity with quality assurance, editorial review, or content evaluation workflows.
• Strong understanding of political systems, governance, elections, public policy, and current political developments.
• Ability to provide objective, impartial, and evidence-based feedback while maintaining consistent quality standards.
• Comfortable working independently in a fast-paced, quality-focused environment.

Engagement Details

• Commitment: 40 hours per week with at least 4 hours PST overlap
• Employment Type: Contractor assignment (no medical/paid leave benefits)
• Duration: 8 weeks