QA Specialist – Audio Annotation & Diarization (Spanish) | Contractor | Fully Remote | 15-Week Engagement
Turing is seeking a detail-oriented QA Specialist with native Spanish proficiency to serve as the final quality checkpoint on an evaluation-grade, multilingual audio annotation dataset. You'll review multi-channel recordings, human-validated transcriptions, and structured metadata to ensure everything meets rigorous accuracy standards for frontier AI development.
About Turing
Based in San Francisco, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for enterprises deploying advanced AI systems. Turing delivers high-quality training data, advanced pipelines, and top-tier AI researchers specializing in coding, reasoning, STEM, multilinguality, and multimodality.
Role Overview
This project involves building a highly accurate dataset of transcribed, multi-channel audio recordings used to evaluate multilingual, multi-speaker AI systems. Contributors record unscripted group conversations that are then transcribed and diarized. As a QA Specialist, you are the final reviewer — ensuring both the audio quality and human-verified annotations meet strict standards before data is finalized.
Key Responsibilities
- Audio Quality Assurance: Evaluate multi-channel recordings for technical fidelity, verifying channel isolation, appropriate recording environments, and the absence of background noise, clipping, or low gain.
- Transcription & Diarization Review: Audit human-validated transcripts for verbatim accuracy, adherence to low Word Error Rate (WER) targets, and correct capture of spontaneous speech including overlaps, interruptions, and false starts.
- Timestamp & Speaker Validation: Confirm precision of turn-level and word-level timestamps and speaker identification, including in complex overlapping dialogue scenarios. Review underlying JSON-formatted data for accurate metadata tagging and timestamp logic.
- Metadata & Content Review: Verify demographic markers, contextual domains, and conversational tags. Enforce privacy and safety standards by auditing for PII, toxic content, or sensitive material.
- Reporting & Feedback: Assign clear pass/fail or agree/disagree statuses and provide detailed, actionable feedback when disagreeing with an annotator's work.
Requirements
- Native proficiency in Spanish
- Exceptional ear for audio fidelity — able to detect subtle noise, channel bleed, or clipping
- Meticulous attention to detail for word-level timestamps and strict verbatim transcription
- Ability to assess complex multi-speaker conversational dynamics accurately
- Comfort reading and validating JSON-formatted annotation data
Ideal Backgrounds
- Linguists / Phonetics Experts: Deep knowledge of natural speech patterns, overlaps, false starts, and backchannels
- Language Teachers: Native-level mastery with strict adherence to verbatim transcription, including disfluencies and filler words
- Professional Transcriptionists: Strong audio fidelity instincts, rigorous timestamping skills, and experience meeting strict accuracy targets
Engagement Details
- Type: Contractor / Freelancer (no medical or paid leave benefits)
- Duration: 15 weeks
- Commitment: Minimum 40 hours/week, at least 4 hours/day with 4 hours of overlap with PST
- Environment: Fully remote
Perks
- Work remotely on cutting-edge AI projects with leading LLM companies
- Potential for contract extension based on performance and project needs
