Posted over 30 days ago. Roles like this often stay open for a while, so it's still worth applying.
Domain Expert – Music at Turing
posted 3 months agoDomain Expert – Music | Varies | Worldwide Remote
Turing is seeking a highly qualified Music Domain Expert to help evaluate and improve Large Language Models (LLMs). In this role, you will design challenging prompts, assess AI-generated responses for accuracy and reasoning quality, and identify knowledge gaps across music theory, genres, composers, artists, production, and instruments. This is a fully remote, flexible contractor opportunity with a world-leading AI research accelerator.
About Turing
Based in San Francisco, California, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing helps customers accelerate frontier research with high-quality data, advanced training pipelines, and top AI specialists — and helps enterprises transform AI from proof of concept into proprietary, measurable intelligence.
Key Responsibilities
- Create advanced prompts covering music theory, genres, composers, artists, production, and instruments.
- Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
- Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
- Develop benchmark datasets and adversarial test cases.
- Provide evidence-based feedback supported by reliable references.
- Collaborate with AI researchers to improve model performance.
- Maintain high annotation quality and thorough documentation.
Minimum Qualifications
- Master's degree or higher in Music or a closely related discipline.
- 3+ years of professional, research, or teaching experience in music.
- Excellent written English and strong analytical skills.
- High attention to detail and ability to evaluate complex content objectively.
Preferred Qualifications
- Experience with LLMs, Generative AI, prompt engineering, or AI evaluation.
- Published research, industry recognition, or formal teaching experience.
- Ability to work independently and deliver objective, evidence-backed reviews.
Sample Tasks
- Write domain-specific prompts of varying difficulty levels.
- Compare multiple AI responses and rank them with justification.
- Explain why a response is correct or incorrect using authoritative references.
- Identify ambiguous questions and propose improved, clearer prompts.
Benefits
- Work on cutting-edge AI projects at the frontier of research.
- Competitive compensation based on experience.
- Fully remote with flexible working hours.