Personal Account Rater - English at Turing

Personal Account Rater (English) | Contractor | Remote | 3–4 Months

Turing is seeking a detail-oriented Personal Account Rater to join a personalization evaluation project assessing the quality of AI-generated responses for professional users. Using your primary Google Workspace account, you will evaluate how effectively AI systems leverage business email history to deliver relevant, personalized, and helpful responses.

Based in San Francisco, Turing is the world's leading research accelerator for frontier AI labs, supporting both cutting-edge AI research and enterprise AI deployment at scale.

Key Responsibilities

• Evaluate AI-generated responses based on your professional email history and business account activity.
• Assess whether responses are relevant, accurate, helpful, and appropriately personalized.
• Identify issues related to incorrect personalization, unsupported assumptions, or irrelevant recommendations.
• Compare multiple AI responses and determine which provides the better overall user experience.
• Provide clear, detailed, and well-reasoned evaluation feedback to support model improvements.
• Follow project guidelines to ensure consistent, accurate, and high-quality evaluations.
• Maintain data privacy and adhere to all project confidentiality requirements.

Requirements

• Language: Native-level proficiency in English (US).
• Google Workspace Account: Must have an active, regularly used Google Workspace account for professional communication. (Mandatory)
• Gmail Language: Gmail display language must be set to English.
• Inbox Language: The majority of inbox emails must be in English. (Mandatory)
• Email History: Well-established business inbox with approximately 1,000+ emails and regular account activity.
• Consent: Willingness to use your primary business account and complete the required consent process.
• Strong analytical thinking, attention to detail, and excellent written communication skills.
• Self-motivated with the ability to work independently in a remote environment.
• Desktop or laptop with a reliable internet connection.

Education & Experience

• Bachelor's degree or equivalent practical experience in any field.
• Experience in AI evaluation, data annotation, content review, or quality assurance is preferred but not required.

Engagement Details

• Type: Contractor
• Duration: 3–4 months
• Commitment: At least 4 hours/day, up to 40 hours/week, with 4 hours of overlap with PST.

Shortlisted candidates will receive a Job Interest Form. Final selections will be contacted with onboarding and consent requirements.