Posted over 30 days ago. Roles like this often stay open for a while, so it's still worth applying.
Domain Expert - Art at Turing
posted 3 months agoDomain Expert – Art | Contractor | 8-Week Engagement | Worldwide Remote
Turing is seeking a highly qualified Art Domain Expert to help evaluate and improve Large Language Models (LLMs). This is a unique opportunity to work at the intersection of art scholarship and cutting-edge AI, contributing directly to the advancement of frontier AI systems.
About Turing
Turing is one of the world's fastest-growing AI companies, partnering with leading AI labs to advance model capabilities in reasoning, knowledge, and multimodality — and applying that work to build real-world AI solutions for enterprise clients.
Role Overview
In this role, you will design challenging prompts, assess AI-generated responses for accuracy and reasoning quality, and identify knowledge gaps across fine arts, visual arts, architecture, design, art history, museums, and notable artists.
Key Responsibilities
- Create advanced, domain-specific prompts of varying difficulty levels covering fine arts, visual arts, architecture, design, art history, museums, and artists.
- Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
- Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
- Develop benchmark datasets and adversarial test cases to stress-test model performance.
- Provide evidence-based feedback supported by authoritative references.
- Collaborate with AI researchers to improve model outputs.
- Maintain high annotation quality and thorough documentation throughout the engagement.
Day-to-Day Tasks
- Write domain-specific prompts across a range of difficulty levels.
- Compare multiple AI responses and rank them with justification.
- Explain why a response is correct or incorrect using credible, authoritative sources.
- Identify ambiguous questions and propose clearer, improved alternatives.
Minimum Qualifications
- Master's degree or higher in Art or a closely related discipline.
- 3+ years of professional, research, or teaching experience in the field.
- Excellent written English and strong analytical skills.
- High attention to detail and commitment to accuracy.
Preferred Qualifications
- Experience with LLMs, Generative AI, prompt engineering, or AI evaluation.
- Published research, industry recognition, or formal teaching experience.
- Ability to work independently and deliver objective, evidence-backed assessments.
Engagement Details
- Commitment: 40 hours per week with at least 4 hours of PST overlap daily.
- Employment Type: Contractor assignment (no medical benefits or paid leave).
- Duration: 8-week contract.