Posted over 30 days ago. Roles like this often stay open for a while, so it's still worth applying.
Domain Expert – Science & Technology at Turing
posted 3 months agoDomain Expert – Science & Technology | Contractor | 8-Week Engagement | Worldwide Remote
Turing is seeking a highly qualified Science & Technology Domain Expert to help evaluate and improve Large Language Models (LLMs). This is a focused 8-week contractor role requiring 40 hours per week, with at least 4 hours of overlap with Pacific Standard Time (PST). You'll work alongside AI researchers to enhance model accuracy, reasoning, and reliability across a broad range of scientific and technical disciplines.
About Turing
Based in San Francisco, California, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing helps accelerate frontier research through high-quality data, advanced training pipelines, and top-tier AI expertise — and applies that knowledge to help enterprises turn AI proof-of-concepts into measurable, lasting business impact.
Key Responsibilities
- Design advanced, challenging prompts spanning physics, chemistry, biology, engineering, AI, computer science, and emerging technologies.
- Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
- Identify hallucinations, logical inconsistencies, outdated information, and edge cases in model outputs.
- Develop benchmark datasets and adversarial test cases to stress-test model capabilities.
- Provide evidence-based feedback supported by reliable, authoritative references.
- Collaborate closely with AI researchers to drive improvements in model performance.
- Maintain high standards of annotation quality and thorough documentation throughout the engagement.
Minimum Qualifications
- Master's degree or higher in a Science & Technology-related discipline.
- 3+ years of professional, research, or teaching experience in a relevant field.
- Excellent written English communication and strong analytical skills.
- High attention to detail and commitment to accuracy.
Preferred Qualifications
- Hands-on experience with LLMs, Generative AI, prompt engineering, or AI evaluation workflows.
- Published research, industry recognition, or formal teaching experience is a strong plus.
- Ability to work independently and deliver objective, evidence-backed assessments.
Engagement Details
- Hours: 40 hours per week, with at least 4 hours PST overlap required.
- Employment Type: Contractor assignment (no medical benefits or paid leave).
- Duration: 8 weeks.