QA Specialist - Audio & Diarization at Turing

QA Specialist – Audio Annotation & Diarization (French) | Contractor | Fully Remote | Turing

Turing is seeking a detail-oriented QA Specialist with native French proficiency to serve as the final quality checkpoint on an evaluation-grade, multilingual audio annotation dataset. This is a fully remote contractor role requiring at least 40 hours per week over a 15-week engagement.

About Turing

Based in San Francisco, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing delivers high-quality data, advanced training pipelines, and top-tier AI expertise across coding, reasoning, STEM, multilinguality, multimodality, and agents.

Role Overview

This project involves building a highly accurate dataset of transcribed, multi-channel audio recordings used to evaluate multilingual, multi-speaker AI systems. Contributors record unscripted group conversations that are then transcribed and diarized. As a QA Specialist, you will review the end-to-end quality of both the audio recordings and the human-verified annotations.

Key Responsibilities

• Audio Quality Assurance: Evaluate multi-channel recordings for technical fidelity, verify channel isolation, and confirm recordings are free from background noise, clipping, or low gain.
• Transcription & Diarization Verification: Review human-validated transcriptions against strict Word Error Rate (WER) targets, ensuring natural speech elements such as overlaps, interruptions, and false starts are accurately captured.
• Timestamp & Speaker Validation: Validate turn-level and word-level timestamps and speaker identification, including in complex overlapping dialogue scenarios. Comfortable reading and validating JSON-formatted data for metadata accuracy.
• Metadata & Content Review: Verify demographic markers, contextual domains, and conversational tags. Audit sessions to ensure no PII, toxic, or sensitive content is present.
• Reporting & Feedback: Assign clear pass/fail or agree/disagree statuses and provide detailed, actionable feedback when disagreeing with an annotator's work.

Requirements

• Native proficiency in French
• Exceptional ear for audio fidelity and ability to detect subtle noise, channel bleed, or clipping
• Meticulous attention to detail for word-level timestamps and verbatim transcription
• Ability to accurately assess complex multi-speaker conversational dynamics

Ideal Backgrounds

• Linguists / Phonetics Experts: Deep knowledge of natural speech patterns, overlaps, false starts, and backchannels
• Language Teachers: Native-level mastery with strict adherence to verbatim transcription guidelines
• Professional Transcriptionists: Strong audio fidelity skills and rigorous timestamping experience

Engagement Details

• Commitment: Minimum 40 hours/week with at least 4 hours of daily overlap with PST
• Type: Contractor/Freelancer (no medical or paid leave benefits)
• Duration: 15 weeks
• Environment: Fully remote

Perks

• Work on cutting-edge AI projects with leading LLM companies
• Fully remote and flexible work environment
• Potential for contract extension based on performance