QA Specialist – Audio Annotation & Diarization (Portuguese) | Contractor | Fully Remote | 15-Week Engagement
Turing is seeking a detail-oriented QA Specialist to serve as the final quality checkpoint for a high-accuracy, evaluation-grade audio dataset project. You will review multi-channel audio recordings, human-validated transcriptions, and speaker diarization outputs to ensure they meet rigorous standards for multilingual AI system evaluation.
About Turing
Based in San Francisco, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing delivers high-quality data, advanced training pipelines, and top-tier AI expertise across coding, reasoning, STEM, multilinguality, multimodality, and agents.
Role Overview
This project involves building a precise, evaluation-grade dataset of transcribed, multi-channel audio recordings used to assess multilingual, multi-speaker AI systems. Contributors record unscripted group conversations, which are then transcribed and diarized. As QA Specialist, you validate the full end-to-end quality of both the audio and the human-verified annotations.
Key Responsibilities
- Audio Quality Assurance: Evaluate multi-channel recordings for technical fidelity, channel isolation, background noise, clipping, and gain issues.
- Transcription Verification: Review human-validated transcripts for accuracy against strict Word Error Rate (WER) targets, ensuring natural speech elements (overlaps, interruptions, false starts) are preserved.
- Diarization Validation: Confirm precision of turn-level and word-level timestamps and speaker identification, including in complex overlapping dialogue scenarios.
- JSON & Metadata Review: Read and validate JSON-formatted annotation data to verify metadata tagging, timestamp logic, demographic markers, and contextual tags.
- Safety & Privacy Auditing: Enforce strict PII, toxic content, and sensitive content standards across all reviewed sessions.
- Reporting: Assign clear pass/fail or agree/disagree statuses and provide detailed, actionable feedback when disagreeing with annotator work.
Requirements
- Native proficiency in Portuguese
- Exceptional ear for audio fidelity — able to detect subtle background noise, channel bleed, or clipping
- Meticulous attention to detail for word-level timestamps and verbatim transcription standards
- Ability to assess complex multi-speaker conversational dynamics accurately
Ideal Backgrounds
- Linguists / Phonetics Experts: Deep knowledge of natural speech patterns, overlaps, false starts, and backchannels
- Language Teachers: Native-level mastery with strict adherence to verbatim transcription, including stutters, fillers, and disfluencies
- Professional Transcriptionists: Rigorous timestamping skills and experience meeting strict accuracy targets
Engagement Details
- Commitment: Minimum 4 hours/day, 40 hours/week, with at least 4 hours overlap with PST
- Type: Contractor / Freelancer (no medical or paid leave benefits)
- Duration: 15 weeks
Perks
- Fully remote work environment
- Opportunity to contribute to cutting-edge AI research projects
- Potential for contract extension based on performance and project needs
