Business Account Rater - Italian at Turing

Business Account Rater (Italian) | Contractor | Remote (Outside US)

Join Turing's AI evaluation team as a Business Account Rater, assessing the quality of personalized AI-generated responses for professional users. This short-term contract role is ideal for detail-oriented individuals with native-level Italian proficiency and an active Google Workspace business account.

About Turing

Based in San Francisco, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing helps accelerate frontier research and supports enterprises in transforming AI from proof of concept into measurable, lasting business impact.

Role Overview

As a Business Account Rater, you will evaluate how effectively AI systems leverage business email history to deliver relevant, personalized, and helpful responses. Your assessments will directly contribute to improving AI model quality and personalization capabilities.

Key Responsibilities

• Evaluate AI-generated responses based on your professional email history and business account activity.
• Assess whether responses are relevant, accurate, helpful, and appropriately personalized.
• Identify issues related to incorrect personalization, unsupported assumptions, or irrelevant recommendations.
• Compare multiple AI responses and determine which provides the better overall user experience.
• Provide clear, detailed, and well-reasoned evaluation feedback to support model improvements.
• Follow project guidelines to ensure consistent, accurate, and high-quality evaluations.
• Maintain data privacy and adhere to all project confidentiality requirements.

Key Qualifications

• Language: Native-level proficiency in Italian (IT). Other accepted languages include Spanish, Portuguese, German, Japanese, Korean, and French.
• Location: Must currently reside outside the United States.
• Business Account (Mandatory): Active Google Workspace (Corporate Gmail) account regularly used for professional communication.
• Gmail Language: Gmail display language must be set to Italian.
• Inbox Language (Mandatory): The majority of inbox emails must be in Italian.
• Email History: Well-established business inbox with approximately 1,000+ emails and regular account activity.
• Analytical Thinking: Ability to evaluate nuanced AI responses and identify strengths and weaknesses in personalization quality.
• Attention to Detail: Strong ability to identify subtle issues or inconsistencies in AI-generated content.
• Communication: Excellent written communication skills for structured evaluation feedback.
• Technical Setup: Desktop or laptop with a reliable internet connection.

Education & Experience

• Bachelor's degree or equivalent practical experience in any field.
• Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical role is preferred but not required.

Engagement Details

• Type: Contractor
• Duration: 3–4 months
• Commitment: At least 4 hours per day, up to 40 hours per week, with 4 hours of overlap with PST.

Evaluation Process

• Shortlisted candidates will receive a Job Interest Form.
• Final selected candidates will be contacted with next steps, including consent and onboarding requirements.
• Candidates must be willing to use their primary business account and sign the required consent form.