Personal Account Generalist Rater at Turing

Personal Account Generalist Rater | Contractor | Remote (Canada)

Turing is looking for Personal Account Generalist Raters based in Canada to participate in Gemini Personalization Evaluations. In this role, you will assess AI-generated responses using personalized prompts that retrieve context and data across connected Google apps — helping improve the quality of frontier AI systems.

About Turing

Based in San Francisco, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI. Turing specializes in high-quality data, advanced training pipelines, and top AI researchers across coding, reasoning, STEM, multilinguality, multimodality, and agents.

Key Responsibilities

• Evaluate AI-generated responses based on personal email history and account activity across Google apps.
• Assess response relevance, accuracy, helpfulness, and personalization quality.
• Identify issues such as incorrect personalization, unsupported assumptions, or irrelevant recommendations.
• Compare multiple AI responses and determine which provides the better overall user experience.
• Provide clear, detailed, and well-reasoned evaluation feedback to support model improvements.
• Follow project guidelines to ensure consistent, high-quality evaluations.
• Maintain data privacy and adhere to all confidentiality requirements throughout the project.

Qualifications

• Location: Must be currently based in Canada.
• App Connectivity: Must be willing to connect Google apps (Gmail, Google Photos, Google Calendar, Google Drive, etc.) to Gemini for data retrieval and evaluation purposes.
• Account Activity: Active use of Google Workspace or consumer apps with sufficient personal data history to generate and evaluate retrieval prompts.
• Analytical Thinking: Ability to evaluate nuanced AI responses and identify strengths and weaknesses in personalization quality.
• Attention to Detail: Strong ability to spot subtle issues or inconsistencies in AI-generated content.
• Communication: Excellent written skills for providing structured evaluation feedback.
• Independence: Self-motivated and comfortable working remotely with minimal supervision.
• Technical Setup: Desktop or laptop with a reliable internet connection.

Education & Experience

• Bachelor's degree or equivalent practical experience in any field.
• Experience in AI evaluation, data annotation, content review, or quality assurance is preferred but not required.

Engagement Details

• Type: Contractor
• Commitment: At least 4 hours/day, up to 40 hours/week, with 4 hours of overlap with PST.
• Duration: Up to 16 weeks

Evaluation Process

• Shortlisted candidates will receive a Job Interest Form.
• Final selected candidates will be contacted with next steps, including consent and onboarding requirements.

Candidates must be willing to grant necessary app integration permissions and complete all standard consent forms and non-disclosure agreements.