Posted over 30 days ago. Roles like this often stay open for a while, so it's still worth applying.
Personal Account Rater - French at Turing
posted 3 months agoPersonal Account Rater (French) | Contractor | Remote (Outside US) | 3–4 Months
Turing is seeking a French-speaking Personal Account Rater to join a personalization evaluation project assessing the quality of AI-generated responses for professional users. Using your primary Google Workspace account, you will evaluate how effectively AI systems leverage business email history to deliver relevant, personalized, and helpful responses.
About Turing
Based in San Francisco, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing accelerates frontier research with high-quality data, advanced training pipelines, and top AI researchers specializing in coding, reasoning, STEM, multilinguality, multimodality, and agents.
Key Qualifications
- Language: Native-level proficiency in French (FR)
- Location: Must currently reside outside the United States
- Google Workspace Account: Must have an active account regularly used for professional communication (mandatory)
- Gmail Language: Display language must be set to French
- Inbox Language: Majority of emails must be in French (mandatory)
- Email History: Well-established business inbox with 1,000+ emails and regular activity
- Consent: Willing to use your primary business account and complete the required consent process
- Analytical Thinking: Ability to evaluate nuanced AI responses and identify personalization strengths and weaknesses
- Attention to Detail: Skilled at identifying subtle issues or inconsistencies in AI-generated content
- Communication: Excellent written skills for structured evaluation feedback
- Technical Setup: Desktop or laptop with a reliable internet connection
Responsibilities
- Evaluate AI-generated responses based on your professional email history and business account activity
- Assess whether responses are relevant, accurate, helpful, and appropriately personalized
- Identify issues related to incorrect personalization, unsupported assumptions, or irrelevant recommendations
- Compare multiple AI responses and determine which provides the better overall user experience
- Provide clear, detailed, and well-reasoned evaluation feedback to support model improvements
- Follow project guidelines to ensure consistent, accurate, and high-quality evaluations
- Maintain data privacy and adhere to all project confidentiality requirements
Education & Experience
- Bachelor's degree or equivalent practical experience in any field
- Experience in AI evaluation, data annotation, content review, or quality assurance is preferred but not required
Engagement Details
- Type: Contractor
- Duration: 3–4 months
- Hours: At least 4 hours/day, up to 40 hours/week, with 4 hours of overlap with PST
Evaluation Process
- Shortlisted candidates will receive a Job Interest Form
- Final selected candidates will be contacted with next steps, including consent and onboarding requirements