Personal Account Rater – German at Turing

Personal Account Rater (German) | Contractor | Remote (Outside US) | 3–4 Months

Turing is seeking a native German speaker to evaluate AI-generated personalized responses using their primary Gmail account. This remote contractor role involves assessing how well an AI system leverages real email history to deliver relevant, accurate, and personalized interactions in both English and German.

About Turing

Based in San Francisco, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing accelerates frontier research with high-quality data, advanced training pipelines, and top AI researchers specializing in coding, reasoning, STEM, multilinguality, and more.

Role Overview

As a Personal Account Rater, you will participate in a personalization evaluation project, assessing the quality of AI-generated responses using your personal Gmail account. You will evaluate how effectively the AI leverages your email history to deliver relevant and personalized responses across English and German.

Key Responsibilities

• Evaluate AI-generated responses based on your personal email history and account activity.
• Assess whether responses are relevant, accurate, helpful, and appropriately personalized.
• Review prompts and AI responses in English while considering personalization across English and German.
• Identify incorrect personalization, unsupported assumptions, or irrelevant recommendations.
• Compare multiple AI responses to determine which provides the better overall user experience.
• Provide clear, detailed, and objective evaluation feedback in accordance with project guidelines.
• Maintain data privacy and follow all project confidentiality requirements throughout the evaluation process.

Key Qualifications

• Language: Native speaker of German (DE).
• Location: Must currently reside outside the United States.
• Gmail Account: Must have an active personal Gmail account (@gmail.com) used as your primary email.
• Mixed-Language Inbox: Inbox must contain a meaningful mix of English and German, with each language representing at least 30% of total inbox content. (Mandatory)
• Email History: Well-established inbox with approximately 1,000+ emails and regular account activity.
• English Proficiency: Comfortable reading, understanding, and evaluating prompts and AI-generated responses in English.
• Analytical Thinking: Ability to assess AI responses for relevance, personalization quality, and overall helpfulness.
• Attention to Detail: Strong ability to identify subtle issues and inconsistencies in AI-generated responses.
• Technical Setup: Desktop or laptop with a reliable internet connection.
• Consent: Willing to use your primary personal Gmail account and complete the required consent process.

Education & Experience

• Bachelor's degree or equivalent practical experience in any field.
• Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical role is preferred but not required.

Engagement Details

• Type: Contractor
• Commitment: At least 4 hours per day, up to 40 hours per week, with 4 hours of overlap with PST.
• Duration: 3–4 months

Evaluation Process

• Shortlisted candidates will be sent a Job Interest Form.
• Final selected candidates will be contacted with next steps, including consent and onboarding requirements.