Business Account Rater - German at Turing

Business Account Rater (German) | Contractor | Remote (Outside US)

Join Turing's AI evaluation team as a Business Account Rater, contributing to a personalization evaluation project that assesses the quality of AI-generated responses for professional users. This is a remote contractor role requiring native-level German proficiency and an active Google Workspace (Corporate Gmail) account used for professional communication.

About Turing

Based in San Francisco, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing helps accelerate frontier research with high-quality data, advanced training pipelines, and top AI researchers specializing in coding, reasoning, STEM, multilinguality, multimodality, and agents.

Role Overview

In this role, you will evaluate how effectively AI systems leverage business email history to deliver relevant, personalized, and helpful responses. Your assessments will directly support model improvements and help shape the future of AI personalization for professional users.

Key Responsibilities

• Evaluate AI-generated responses based on your professional email history and business account activity.
• Assess whether responses are relevant, accurate, helpful, and appropriately personalized.
• Identify issues related to incorrect personalization, unsupported assumptions, or irrelevant recommendations.
• Compare multiple AI responses and determine which provides the better overall user experience.
• Provide clear, detailed, and well-reasoned evaluation feedback to support model improvements.
• Follow project guidelines to ensure consistent, accurate, and high-quality evaluations.
• Maintain data privacy and adhere to all project confidentiality requirements.

Required Qualifications

• Language: Native-level proficiency in German (DE). Other eligible languages include Japanese, Korean, and French.
• Location: Must currently reside outside the United States.
• Business Account: Active Google Workspace (Corporate Gmail) account regularly used for professional communication. (Mandatory)
• Gmail Language: Gmail display language must be set to the target project language.
• Inbox Language: Majority of inbox emails must be in the target language. (Mandatory)
• Email History: Well-established business inbox with approximately 1,000+ emails and regular account activity.
• Analytical Thinking: Ability to evaluate nuanced AI responses and identify strengths and weaknesses in personalization quality.
• Attention to Detail: Strong ability to spot subtle issues or inconsistencies in AI-generated content.
• Communication: Excellent written communication skills for structured evaluation feedback.
• Technical Setup: Desktop or laptop with a reliable internet connection.

Education & Experience

• Bachelor's degree or equivalent practical experience in any field.
• Experience in AI evaluation, data annotation, content review, or quality assurance is preferred but not required.

Engagement Details

• Type: Contractor
• Commitment: At least 4 hours/day, up to 40 hours/week, with 4 hours of overlap with PST.
• Duration: 3–4 months

Evaluation Process

• Shortlisted candidates will receive a Job Interest Form.
• Final selected candidates will be contacted with next steps, including consent and onboarding requirements.