Posted over 30 days ago. Roles like this often stay open for a while, so it's still worth applying.
Domain Expert Reviewer – Sci & Tech at Turing
posted 3 months agoDomain Expert Reviewer – Science & Technology | Contractor | 40 hrs/week | Worldwide Remote
Turing is looking for a highly qualified Science & Technology Domain Reviewer to support quality assurance for Large Language Model (LLM) evaluation projects. This is an 8-week contractor engagement requiring 40 hours per week with at least 4 hours of PST overlap. Your deep domain expertise will directly shape the reliability and accuracy of AI training data across a wide range of scientific and technological disciplines.
About Turing
Based in San Francisco, California, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing helps customers accelerate frontier research with high-quality data, advanced training pipelines, and top AI researchers — and helps enterprises transform AI from proof of concept into measurable, lasting business impact.
Key Responsibilities
- Review and validate domain-specific prompts covering physics, chemistry, biology, engineering, artificial intelligence, computer science, and emerging technologies.
- Evaluate completed tasks for factual accuracy, reasoning quality, completeness, technical correctness, and compliance with project guidelines.
- Identify factual inaccuracies, logical inconsistencies, hallucinations, outdated information, and low-quality annotations.
- Ensure prompts are challenging, relevant, and aligned with project objectives.
- Provide clear, constructive, and evidence-based feedback to contributors to improve task quality.
- Maintain consistency across reviews by following established quality standards and guidelines.
- Escalate ambiguous or technically complex cases and document review findings as needed.
- Collaborate with project managers and AI teams to continuously improve evaluation quality and review processes.
Minimum Qualifications
- Master's degree or higher in Physics, Chemistry, Biology, Engineering, Computer Science, Information Technology, Artificial Intelligence, or a closely related Science & Technology discipline.
- Minimum 3 years of professional, research, teaching, or industry experience in a relevant science or technology field.
- Prior experience reviewing, evaluating, editing, or quality-checking technical or domain-specific content is preferred.
- Excellent written English communication and strong analytical skills.
- Sharp attention to detail with the ability to identify factual, logical, and technical errors.
Preferred Qualifications
- Experience reviewing AI-generated content, LLM evaluations, prompt engineering, or annotation quality.
- Familiarity with quality assurance, editorial review, or technical content evaluation workflows.
- Strong understanding of scientific principles, technological advancements, and emerging technologies.
- Ability to deliver objective, evidence-based feedback while maintaining consistent quality standards.
- Comfortable working independently in a fast-paced, quality-focused environment.
Engagement Details
- Hours: 40 hours per week with at least 4 hours PST overlap
- Employment Type: Contractor assignment (no medical/paid leave benefits)
- Duration: 8 weeks