Mobile AI Rater (Samsung Android) at Turing

Mobile AI Rater | ~$15/hr | Remote

About Turing

Turing works with frontier AI labs to generate high-quality data, evaluations, and reinforcement learning environments that improve model capabilities. In coding, Turing is the largest and longest-running data provider in the category, and it also works with Fortune 500 enterprises to build and deploy agentic AI systems.

Role Overview

Join an AI evaluation project focused on improving how AI understands personal context and delivers relevant, personalized responses. As a Mobile AI Rater, you will review AI-generated outputs using selected data from G-Suite Apps, along with relevant content from Google Messages and device SMS. Your feedback will help assess the accuracy, relevance, and quality of AI personalization in real-world scenarios.

What You'll Do

• Review AI-generated prompts and responses in English.
• Evaluate responses for relevance, accuracy, helpfulness, and personalization.
• Assess how well AI understands everyday context, preferences, relationships, routines, and experiences.
• Provide clear ratings, explanations, and feedback.
• Follow project guidelines and maintain a high level of consistency.
• Help improve the quality and reliability of next-generation AI systems.

Requirements

• A primary Samsung Android Smartphone.
• Android 16 or higher.
• Regular use of the Google Messages app for personal SMS/RCS conversations.
• Comfortable reviewing AI content in English.

Pay and Schedule

• Rate: approximately $15/hr, paid in USD.
• 16-week project with potential for extension.
• Commitment of up to 40 hours/week.
• Fully remote. Potential start date: as soon as possible.

Selection Process

• Fill in the application form with accurate information.
• Candidates will be selected based on internal profile and client review.