Data Annotation & AI Evaluation Generalist at Turing
posted 7 hours agoData Annotation & AI Evaluation Generalist | Pay per task | Remote
Turing is hiring for a short-term human-AI interaction evaluation pilot. The pilot tests whether providing social context before a user's request helps a language model generate more relevant, personalized, and user-aligned advice. Contributors create realistic, ongoing social scenarios, interact with the model under different conditions, and evaluate the quality of its responses.
What the work involves
- Creating realistic, ongoing social scenarios involving personal, professional, or interpersonal context
- Interacting with the language model under assigned evaluation conditions
- Evaluating model responses for relevance, usefulness, personalization, clarity, and alignment with the provided context
- Explaining the reasoning behind each rating through clear and detailed written feedback
- Following project guidelines and completing assigned tasks within the required timeline
Who this is for
- Strong written English proficiency and clear communication skills
- Creative and analytical thinking for developing realistic social scenarios
- An educational or professional background in Business Analysis, English, Literature, Journalism, Creative Writing, Scriptwriting, Content Writing, Film and Video Captioning, or a related field
- The ability to understand nuanced interpersonal situations and evaluate AI-generated responses objectively
- Three or more years of experience in data annotation, human-AI interaction, content evaluation, or similar analytical projects — preferred but not mandatory
Project details
- Duration: 2-3 weeks (short-term project)
- Pay structure: pay-per-task (PPT)
- Average handling time: approximately 60 minutes per task
- Engagement: full time
- Estimated start date: 1 October (or nearby dates)