Business Account Rater (Japanese) | Contractor | Remote (Outside US)
Join Turing's AI evaluation team as a Business Account Rater for a personalization assessment project. You'll evaluate AI-generated responses using your active Google Workspace (Corporate Gmail) account, helping improve how AI systems deliver relevant, personalized experiences for professional users. This is a short-term remote contract role ideal for detail-oriented professionals with strong analytical skills.
About Turing
Based in San Francisco, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing accelerates frontier research with high-quality data, advanced training pipelines, and top AI researchers specializing in coding, reasoning, STEM, multilinguality, multimodality, and agents.
Role Overview
As a Business Account Rater, you will assess the quality of AI-generated responses for professional users, evaluating how effectively the system leverages business email history to deliver relevant and helpful outputs. This role requires strong analytical thinking, attention to detail, and the ability to evaluate AI outputs objectively.
Key Responsibilities
- Evaluate AI-generated responses based on your professional email history and business account activity.
- Assess whether responses are relevant, accurate, helpful, and appropriately personalized.
- Identify issues related to incorrect personalization, unsupported assumptions, or irrelevant recommendations.
- Compare multiple AI responses and determine which provides the better overall user experience.
- Provide clear, detailed, and well-reasoned evaluation feedback to support model improvements.
- Follow project guidelines to ensure consistent, accurate, and high-quality evaluations.
- Maintain data privacy and adhere to all project confidentiality requirements.
Key Qualifications
- Language: Native-level proficiency in Japanese (JP).
- Location: Must currently reside outside the United States.
- Business Account: Active Google Workspace (Corporate Gmail) account used regularly for professional communication. (Mandatory)
- Gmail Language: Gmail display language must be set to Japanese.
- Inbox Language: Majority of inbox emails must be in Japanese. (Mandatory)
- Email History: Well-established business inbox with approximately 1,000+ emails and regular account activity.
- Consent: Willingness to use your primary business account and complete the required consent process.
- Exceptional analytical thinking and attention to detail.
- Excellent written communication skills for structured evaluation feedback.
- Self-motivated and able to work independently in a remote environment.
- Desktop or laptop with a reliable internet connection.
Education & Experience
- Bachelor's degree or equivalent practical experience in any field.
- Experience in AI evaluation, data annotation, content review, or quality assurance is preferred but not required.
Engagement Details
- Type: Contractor
- Duration: 3–4 months
- Commitment: At least 4 hours/day, up to 40 hours/week, with 4 hours of overlap with PST.
Evaluation Process
- Shortlisted candidates will receive a Job Interest Form.
- Final selected candidates will be contacted with next steps, including consent and onboarding requirements.
