Business Account Rater (KO/DE/FR) at Turing

Business Account Rater (Bilingual: Korean, German, or French) | Contractor | Remote (Outside US)

Join Turing's AI evaluation team and help shape the future of personalized AI for business users. In this role, you'll assess the quality of AI-generated responses using your professional Google Workspace inbox, providing structured feedback that directly improves model performance.

About Turing

Based in San Francisco, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing helps customers accelerate frontier research and transform AI from proof of concept into measurable business impact.

Role Overview

As a Business Account Rater, you will evaluate AI-generated responses for professional users, assessing how well the system leverages business email history to deliver relevant, personalized, and helpful outputs. This role demands strong analytical thinking, attention to detail, and objective evaluation skills.

Key Responsibilities

• Evaluate AI-generated responses based on your professional email history and business account activity.
• Assess relevance, accuracy, helpfulness, and personalization quality of AI outputs.
• Identify issues such as incorrect personalization, unsupported assumptions, or irrelevant recommendations.
• Compare multiple AI responses and determine which provides the best user experience.
• Provide clear, detailed, and well-reasoned evaluation feedback to support model improvements.
• Follow project guidelines to ensure consistent, high-quality evaluations.
• Maintain strict data privacy and adhere to all confidentiality requirements.

Required Qualifications

• Language: Native-level proficiency in Korean, German, or French, plus strong professional English proficiency.
• Location: Must currently reside outside the United States.
• Business Account: Active Google Workspace (Corporate Gmail) account used regularly for professional communication. (Mandatory)
• Inbox Language Mix: Business inbox must contain at least 30% native language emails and at least 30% English emails. (Mandatory)
• Gmail Display Language: Must be set to the target project language.
• Email History: Well-established inbox with approximately 1,000+ emails and regular account activity.
• Consent: Willingness to use your primary business account and complete the required consent process.
• Technical Setup: Desktop or laptop with a reliable internet connection.

Education & Experience

• Bachelor's degree or equivalent practical experience in any field.
• Experience in AI evaluation, data annotation, content review, or quality assurance is preferred but not required.

Engagement Details

• Type: Contractor
• Commitment: Minimum 4 hours/day, up to 40 hours/week, with 4 hours of overlap with PST.
• Duration: 3–4 months

Evaluation Process

• Shortlisted candidates will receive a Job Interest Form.
• Final selected candidates will be contacted with next steps, including consent and onboarding requirements.