Domain Expert Reviewer – Art | Contractor | 8-Week Engagement | Worldwide Remote
Turing is seeking a highly qualified Art Domain Expert Reviewer to support quality assurance for Large Language Model (LLM) evaluation projects. In this role, you will review and validate art-related prompts and completed AI annotation tasks, ensuring factual accuracy, logical consistency, and adherence to project guidelines. Your expertise will directly contribute to the reliability and quality of AI training data across a wide range of art-related subjects.
This is a contractor role requiring 40 hours per week with at least 4 hours of PST overlap, for a duration of 8 weeks.
About Turing
Based in San Francisco, California, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing helps accelerate frontier research with high-quality data, advanced training pipelines, and top AI researchers specializing in coding, reasoning, STEM, multilinguality, multimodality, and agents.
Key Responsibilities
- Review and validate domain-specific prompts covering art history, visual arts, fine arts, architecture, design, artists, art movements, museums, and related topics.
- Evaluate completed tasks for factual accuracy, reasoning quality, completeness, and compliance with project guidelines.
- Identify factual inaccuracies, logical inconsistencies, hallucinations, outdated information, and low-quality annotations.
- Ensure prompts are challenging, relevant, and aligned with project objectives.
- Provide clear, constructive, and evidence-based feedback to contributors to improve task quality.
- Maintain consistency across reviews by following established quality standards and guidelines.
- Escalate ambiguous or complex cases when necessary and document review findings.
- Collaborate with project managers and AI teams to continuously improve evaluation quality and review processes.
Minimum Qualifications
- Master's degree or higher in Art, Art History, Fine Arts, Design, Architecture, Visual Arts, or a closely related discipline.
- Minimum 3 years of professional, research, teaching, or industry experience in the art domain.
- Prior experience reviewing, evaluating, editing, or quality-checking domain-specific content is preferred.
- Excellent written English communication and strong analytical skills.
- Sharp attention to detail with the ability to identify factual, logical, and contextual errors.
Engagement Details
- Commitment: 40 hours per week with at least 4 hours PST overlap
- Employment Type: Contractor (no medical/paid leave benefits)
- Duration: 8 weeks
