Philosophical Logic Annotator at Turing
posted 37 minutes agoPhilosophical Logic Annotator | Contractor | One-week engagement
About the role
Evaluate short claims and groups of claims for Turing’s advanced reasoning dataset. Assess clarity, consistency, logical incompatibility, and whether a set of views covers the main positions on a question.
What you’ll do
- Review whether individual claims are clear and understandable on their own.
- Determine whether multiple claims can be true at the same time and identify logical contradictions.
- Distinguish contradiction from disagreement, uncertainty, or insufficient evidence.
- Assess whether groups of views adequately represent the main positions on a question.
- Follow detailed scoring guidelines and provide concise explanations for difficult judgments.
- Participate in initial calibration, incorporate reviewer feedback, and flag ambiguous cases rather than guessing.
- Complete assigned tasks accurately within the five-day execution window.
Requirements
- A PhD in philosophy, logic, formal semantics, or a closely related field; or at least five years of relevant professional or research experience in philosophical logic, analytic philosophy, formal semantics, or epistemology.
- Strong knowledge of formal logic, analytic philosophy, philosophy of language, or epistemology.
- Understanding of logical contradiction, consistency, truth conditions, and incompatibility.
- Ability to interpret claims carefully and identify subtle differences in wording.
- Ability to apply detailed evaluation guidelines consistently and objectively.
- Excellent written English, strong attention to detail, and comfort explaining nuanced judgments briefly.
- Availability throughout the five-day execution period.
Pay and schedule
- Contractor engagement lasting one week.
- Up to 40 hours per week, with four hours of overlap with PST.
- Pay is not specified in the listing.
Location
The listing does not specify a work location or applicant country eligibility.
Selection process
Candidates must submit a job interest form and complete an assessment.