Benture logo
Turing logo

Biology Subject Matter Expert (LLM Evaluation) at Turing

posted 26 minutes ago
turing.com Contractor remote in US Varies 23 views

Biology Subject Matter Expert | Remote (US) | Contractor, 6-week project | Pay varies

About the Role

Turing, an AI company that works with leading AI labs and builds real-world AI systems, is seeking an analytical, detail-oriented Biology Subject Matter Expert (SME) to evaluate, benchmark, and fine-tune next-generation large language models (LLMs). You will apply deep biological domain expertise and strong English comprehension to test model boundaries, solve complex scientific problems, and author gold-standard explanations, breaking down advanced biological concepts — from competitive entrance exam fundamentals to graduate and doctoral-level theory — into clear, logical frameworks.

Responsibilities

  • Problem design and stress-testing: author challenging, multi-step biology problems designed to probe the reasoning limitations of LLMs.
  • Gold-standard solution authoring: develop thorough step-by-step solutions with rigorous scientific reasoning, conceptual clarity, and accurate data interpretation.
  • Benchmark development: contribute to new evaluation benchmarks spanning foundational undergraduate biology curricula through advanced PhD-level research topics.
  • Research alignment and error analysis: collaborate with LLM researchers on areas where models typically struggle, such as conceptual abstraction and experimental data analysis, providing structured feedback and detailed annotations.

Required Qualifications

  • Strong theoretical and applied command of biology, comparable to competitive entrance exam rigor through graduate/doctoral-level standards.
  • Sharp analytical thinking and research skills to validate scientific claims, interpret experimental data, and solve multi-variable problems systematically.
  • Ability to translate dense biological mechanisms into clear, plain-English explanations and provide structured, constructive annotations.
  • Creative and lateral thinking to craft novel problem scenarios that test true conceptual understanding rather than rote memorization.
  • Self-motivated work ethic with strong written communication skills for asynchronous collaboration in a remote environment.
  • A personal desktop or laptop with a reliable, high-speed internet connection.

Preferred Qualifications

  • Currently pursuing or holding a Master's, Ph.D., or postdoctoral degree in Biology, Biotechnology, Biochemistry, Molecular Biology, or a closely related life sciences discipline.
  • Proven ability to deconstruct complex biological pathways, experimental designs, or quantitative biology problems into logical steps.
  • Experience teaching, tutoring, or explaining complex scientific concepts using clear language, diagrams, or visual aids.

Pay, Schedule and Location

  • Project-based contractor role with a defined number of evaluation tasks; the project runs for 6 weeks.
  • Pay is not specified in the source listing.
  • Fully remote and flexible work environment; the role is US-based.
  • An assessment is required to move forward.
Benture logo
See All Jobs
Apply Back