This job post has expired on August 14, 2026. It is likely that the position has already been filled.
Business Account Rater - Korean at Turing
posted 3 months agoBusiness Account Rater (Korean) | Contractor | Remote (Outside US)
Join Turing's AI evaluation team as a Business Account Rater for a personalization assessment project. In this role, you will evaluate AI-generated responses for professional users, helping improve how AI systems leverage business email history to deliver relevant, accurate, and personalized results. This is a short-term contractor engagement ideal for detail-oriented professionals with native Korean proficiency and an active Google Workspace account.
Key Responsibilities
- Evaluate AI-generated responses based on your professional email history and business account activity.
- Assess whether responses are relevant, accurate, helpful, and appropriately personalized.
- Identify issues related to incorrect personalization, unsupported assumptions, or irrelevant recommendations.
- Compare multiple AI responses and determine which provides the better overall user experience.
- Provide clear, detailed, and well-reasoned evaluation feedback to support model improvements.
- Follow project guidelines to ensure consistent, accurate, and high-quality evaluations.
- Maintain data privacy and adhere to all project confidentiality requirements.
Required Qualifications
- Language: Native-level proficiency in Korean (KO).
- Location: Must currently reside outside the United States.
- Business Account: Active Google Workspace (Corporate Gmail) account regularly used for professional communication. (Mandatory)
- Gmail Language: Gmail display language must be set to Korean.
- Inbox Language: Majority of inbox emails must be in Korean. (Mandatory)
- Email History: Well-established business inbox with approximately 1,000+ emails and regular account activity.
- Consent: Willingness to use your primary business account and complete the required consent process.
- Strong analytical thinking, attention to detail, and written communication skills.
- Self-motivated with the ability to work independently in a remote environment.
- Desktop or laptop with a reliable internet connection.
Education & Experience
- Bachelor's degree or equivalent practical experience in any field.
- Experience in AI evaluation, data annotation, content review, or quality assurance is preferred but not required.
Engagement Details
- Type: Contractor
- Duration: 3–4 months
- Hours: Minimum 4 hours/day, up to 40 hours/week, with 4 hours of overlap with PST.
Evaluation Process
- Shortlisted candidates will receive a Job Interest Form.
- Final selected candidates will be contacted with next steps, including consent and onboarding requirements.