Benture logo
Turing logo

Data Annotation & AI Evaluation Generalist at Turing

posted 7 hours ago
turing.com Contractor remote Varies 46 views

Data Annotation & AI Evaluation Generalist | Pay per task | Remote

Turing is hiring for a short-term human-AI interaction evaluation pilot. The pilot tests whether providing social context before a user's request helps a language model generate more relevant, personalized, and user-aligned advice. Contributors create realistic, ongoing social scenarios, interact with the model under different conditions, and evaluate the quality of its responses.

What the work involves

  • Creating realistic, ongoing social scenarios involving personal, professional, or interpersonal context
  • Interacting with the language model under assigned evaluation conditions
  • Evaluating model responses for relevance, usefulness, personalization, clarity, and alignment with the provided context
  • Explaining the reasoning behind each rating through clear and detailed written feedback
  • Following project guidelines and completing assigned tasks within the required timeline

Who this is for

  • Strong written English proficiency and clear communication skills
  • Creative and analytical thinking for developing realistic social scenarios
  • An educational or professional background in Business Analysis, English, Literature, Journalism, Creative Writing, Scriptwriting, Content Writing, Film and Video Captioning, or a related field
  • The ability to understand nuanced interpersonal situations and evaluate AI-generated responses objectively
  • Three or more years of experience in data annotation, human-AI interaction, content evaluation, or similar analytical projects — preferred but not mandatory

Project details

  • Duration: 2-3 weeks (short-term project)
  • Pay structure: pay-per-task (PPT)
  • Average handling time: approximately 60 minutes per task
  • Engagement: full time
  • Estimated start date: 1 October (or nearby dates)
Benture logo
See All Jobs
Apply Back