QA Specialist – Audio Annotation & Diarization (Spanish LATAM) | Contractor | Fully Remote | 15-Week Engagement
Turing is seeking a detail-oriented QA Specialist to serve as the final quality checkpoint on an evaluation-grade, multilingual audio annotation dataset. You will review multi-channel audio recordings, human-validated transcriptions, and diarization outputs to ensure they meet rigorous accuracy and fidelity standards for frontier AI research.
About Turing
Based in San Francisco, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing helps customers accelerate frontier research with high-quality data, advanced training pipelines, and top AI researchers — and applies that expertise to help enterprises transform AI from proof of concept into proprietary intelligence.
Role Overview
This project involves building a highly accurate dataset of transcribed, multi-channel audio recordings used to evaluate multilingual, multi-speaker AI systems. Contributors record unscripted group conversations, which are then transcribed and diarized. As QA Specialist, you review the end-to-end quality of both the audio and the human-verified annotations.
Key Responsibilities
Audio Quality Assurance
- Evaluate multi-channel recordings for technical fidelity, including channel isolation, background noise, clipping, and gain levels.
- Confirm recordings were captured in appropriate, quiet environments free from disruptive audio artifacts.
Transcription & Diarization Verification
- Review human-validated transcriptions to ensure exceptionally high accuracy and low Word Error Rate (WER).
- Confirm transcripts capture spontaneous, unnormalized speech — including overlaps, interruptions, and false starts.
- Validate turn-level and word-level timestamps and speaker identification, with special attention to overlapping dialogue.
- Read and validate underlying JSON-formatted data to ensure accurate metadata tagging and timestamp logic.
Metadata & Content Review
- Verify accuracy of all metadata, including demographic markers, contextual domains, and conversational tags.
- Audit sessions to ensure no Personally Identifying Information (PII), toxic, or sensitive content is present.
- Assign clear pass/fail or agree/disagree statuses and provide detailed, actionable feedback when disagreeing with an annotator's work.
Requirements & Qualifications
- Native proficiency in Spanish (Latin American)
- Exceptional ear for audio fidelity — able to detect subtle background noise, channel bleed, or clipping
- Meticulous attention to detail for word-level timestamps and strict verbatim transcription
- Ability to accurately assess complex multi-speaker conversational dynamics
Ideal Backgrounds Include:
- Linguists / Phonetics Experts: Deep understanding of natural speech patterns, overlaps, false starts, and backchannels
- Language Teachers: Native-level mastery with strict adherence to verbatim transcription guidelines
- Professional Transcriptionists: Rigorous timestamping skills and experience meeting strict accuracy targets
Engagement Details
- Type: Contractor / Freelancer (no medical or paid leave)
- Duration: 15 weeks
- Commitment: Minimum 4 hours/day, 40 hours/week, with at least 4 hours overlap with PST
Why Work With Turing?
- Fully remote work environment
- Opportunity to contribute to cutting-edge AI research with leading LLM companies
- Potential for contract extension based on performance and project needs
