QA Specialist – Audio Annotation & Diarization (German) | Contractor | Fully Remote | 15-Week Engagement
Turing is seeking a detail-oriented QA Specialist with native German proficiency to serve as the final quality checkpoint on an evaluation-grade, multilingual audio annotation dataset. You'll review multi-channel recordings, human-validated transcriptions, and diarization outputs to ensure they meet rigorous accuracy standards for frontier AI development.
About Turing
Based in San Francisco, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing delivers high-quality training data, advanced pipelines, and top-tier AI expertise spanning coding, reasoning, STEM, multilinguality, multimodality, and agents.
Role Overview
This project focuses on building a highly accurate dataset of transcribed, multi-channel audio recordings used to evaluate multilingual, multi-speaker AI systems. Contributors record unscripted group conversations, which are transcribed and diarized, then human-validated. As QA Specialist, you are the final reviewer — ensuring both audio quality and annotation accuracy meet strict standards.
Key Responsibilities
Audio Quality Assurance
- Evaluate multi-channel recordings for technical fidelity and adherence to quality requirements.
- Verify channel isolation, confirm quiet recording environments, and flag issues such as audio bleed, clipping, or low gain.
Transcription & Diarization Verification
- Review human-validated transcriptions against strict low Word Error Rate (WER) targets.
- Confirm accurate capture of spontaneous, unnormalized speech including overlaps, interruptions, and false starts.
- Validate turn-level and word-level timestamps and speaker identification in complex, overlapping dialogue.
- Read and validate underlying JSON-formatted data to ensure accurate metadata tagging and timestamp logic.
Metadata & Content Review
- Verify accuracy of demographic markers, contextual domains, and conversational tags.
- Audit sessions to ensure no Personally Identifiable Information (PII), toxic, or sensitive content is present.
- Assign clear pass/fail or agree/disagree statuses and provide detailed, actionable feedback when disagreeing with annotator work.
Requirements & Qualifications
- Native proficiency in German (required).
- Exceptional ear for audio fidelity — able to detect subtle background noise, channel bleed, or clipping.
- Meticulous attention to detail for word-level timestamps and verbatim transcription standards.
- Ability to accurately assess complex multi-speaker conversational dynamics.
Ideal Backgrounds Include:
- Linguists / Phonetics Experts: Deep understanding of natural speech patterns, overlaps, false starts, and backchannels.
- Language Teachers: Native-level mastery with strict adherence to verbatim transcription — documenting every stutter, filler, and disfluency.
- Professional Transcriptionists: Proven audio fidelity skills, rigorous timestamping experience, and a track record of meeting strict accuracy targets.
Engagement Details
- Commitment: Minimum 4 hours/day, 40 hours/week, with at least 4 hours overlap with PST.
- Type: Contractor / Freelancer (no medical or paid leave benefits).
- Duration: 15 weeks.
Perks of Working with Turing
- Fully remote work environment.
- Opportunity to contribute to cutting-edge AI projects with leading LLM companies.
- Potential for contract extension based on performance and project needs.
