Biology Subject Matter Expert (LLM Evaluation) at Turing
posted 26 minutes agoBiology Subject Matter Expert | Remote (US) | Contractor, 6-week project | Pay varies
About the Role
Turing, an AI company that works with leading AI labs and builds real-world AI systems, is seeking an analytical, detail-oriented Biology Subject Matter Expert (SME) to evaluate, benchmark, and fine-tune next-generation large language models (LLMs). You will apply deep biological domain expertise and strong English comprehension to test model boundaries, solve complex scientific problems, and author gold-standard explanations, breaking down advanced biological concepts — from competitive entrance exam fundamentals to graduate and doctoral-level theory — into clear, logical frameworks.
Responsibilities
- Problem design and stress-testing: author challenging, multi-step biology problems designed to probe the reasoning limitations of LLMs.
- Gold-standard solution authoring: develop thorough step-by-step solutions with rigorous scientific reasoning, conceptual clarity, and accurate data interpretation.
- Benchmark development: contribute to new evaluation benchmarks spanning foundational undergraduate biology curricula through advanced PhD-level research topics.
- Research alignment and error analysis: collaborate with LLM researchers on areas where models typically struggle, such as conceptual abstraction and experimental data analysis, providing structured feedback and detailed annotations.
Required Qualifications
- Strong theoretical and applied command of biology, comparable to competitive entrance exam rigor through graduate/doctoral-level standards.
- Sharp analytical thinking and research skills to validate scientific claims, interpret experimental data, and solve multi-variable problems systematically.
- Ability to translate dense biological mechanisms into clear, plain-English explanations and provide structured, constructive annotations.
- Creative and lateral thinking to craft novel problem scenarios that test true conceptual understanding rather than rote memorization.
- Self-motivated work ethic with strong written communication skills for asynchronous collaboration in a remote environment.
- A personal desktop or laptop with a reliable, high-speed internet connection.
Preferred Qualifications
- Currently pursuing or holding a Master's, Ph.D., or postdoctoral degree in Biology, Biotechnology, Biochemistry, Molecular Biology, or a closely related life sciences discipline.
- Proven ability to deconstruct complex biological pathways, experimental designs, or quantitative biology problems into logical steps.
- Experience teaching, tutoring, or explaining complex scientific concepts using clear language, diagrams, or visual aids.
Pay, Schedule and Location
- Project-based contractor role with a defined number of evaluation tasks; the project runs for 6 weeks.
- Pay is not specified in the source listing.
- Fully remote and flexible work environment; the role is US-based.
- An assessment is required to move forward.