Data Annotation Generalist (English) at Turing

Data Annotation Generalist | Pay per task | Remote | Short-term pilot (2-3 weeks, starting around 1 October)

About the role

Turing is seeking contributors for a short-term human-AI interaction evaluation pilot. The project tests whether giving a language model social context before a user's request helps it produce more relevant, personalized, and user-aligned advice. You will create realistic social scenarios, interact with the model under different conditions, and evaluate the quality of its responses.

What the work involves

• Create realistic, ongoing social scenarios involving personal, professional, or interpersonal context.
• Interact with the language model under assigned evaluation conditions.
• Evaluate model responses for relevance, usefulness, personalization, clarity, and alignment with the provided context.
• Explain the reasoning behind each rating through clear, detailed written feedback.
• Follow project guidelines and complete assigned tasks within the required timeline.

Who it's for

• Strong written English proficiency and clear communication skills.
• Creative and analytical thinking when developing realistic social scenarios.
• An educational or professional background in Business Analysis, English, Literature, Journalism, Creative Writing, Scriptwriting, Content Writing, Film and Video Captioning, or a related field.
• Ability to understand nuanced interpersonal situations and evaluate AI-generated responses objectively.
• Three or more years of experience in data annotation, human-AI interaction, content evaluation, or similar analytical projects (preferred but not mandatory).

Pay and schedule

• Project type: pay-per-task.
• Project duration: 2-3 weeks (short term).
• Estimated average handling time: about 60 minutes per task.
• Engagement: full time.
• Estimated start date: 1 October, or nearby dates.