Personal Account Rater - Korean at Turing

Personal Account Rater (Korean) | Contractor | Remote (Outside US) | 3–4 Months

Turing is seeking a native Korean speaker to evaluate AI-generated personalized responses using their personal Gmail account. This remote contractor role involves assessing how well an AI system leverages real email history to deliver relevant, accurate, and personalized outputs in both English and Korean.

About Turing

Based in San Francisco, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing specializes in high-quality data, advanced training pipelines, and top AI researchers across coding, reasoning, STEM, multilinguality, and more.

Key Responsibilities

• Evaluate AI-generated responses based on your personal Gmail history and account activity.
• Assess whether responses are relevant, accurate, helpful, and appropriately personalized.
• Review prompts and AI responses in English while considering personalization across English and Korean.
• Identify incorrect personalization, unsupported assumptions, or irrelevant recommendations.
• Compare multiple AI responses to determine which provides the better overall user experience.
• Provide clear, detailed, and objective evaluation feedback following project guidelines.
• Maintain data privacy and adhere to all project confidentiality requirements.

Key Qualifications

• Language: Native Korean (KO) speaker with strong English proficiency.
• Location: Must currently reside outside the United States.
• Gmail Account: Must have an active personal Gmail (@gmail.com) used as your primary email.
• Mixed-Language Inbox: Inbox must contain at least 30% English and 30% Korean content (mandatory).
• Email History: Well-established inbox with approximately 1,000+ emails and regular activity.
• Analytical Skills: Strong ability to assess AI responses for relevance, personalization quality, and helpfulness.
• Attention to Detail: Ability to identify subtle issues and inconsistencies in AI-generated content.
• Communication: Excellent written communication skills for structured evaluation feedback.
• Technical Setup: Desktop or laptop with a reliable internet connection.

Education & Experience

• Bachelor's degree or equivalent practical experience in any field.
• Experience in AI evaluation, data annotation, content review, or quality assurance is preferred but not required.

Engagement Details

• Type: Contractor
• Duration: 3–4 months
• Hours: Minimum 4 hours/day, up to 40 hours/week with at least 4 hours of overlap with PST.
• Consent: Must be willing to use your primary personal Gmail account and complete the required consent process.

Evaluation Process

• Shortlisted candidates will receive a Job Interest Form.
• Final selected candidates will be contacted with next steps, including consent and onboarding requirements.