QA Specialist – Audio Annotation & Diarization (Portuguese) | Contractor | Fully Remote | 15-Week Engagement
Turing is seeking a detail-oriented QA Specialist with native Portuguese proficiency to serve as the final quality checkpoint on an evaluation-grade, multilingual audio annotation dataset. You'll review multi-channel recordings, human-validated transcriptions, and speaker diarization outputs to ensure the highest standards of accuracy for frontier AI research.
About Turing
Based in San Francisco, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing delivers high-quality training data, advanced pipelines, and top-tier AI expertise across coding, reasoning, STEM, multilinguality, multimodality, and agents.
Role Overview
This project involves building a highly accurate dataset of transcribed, multi-channel audio recordings used to evaluate multilingual, multi-speaker AI systems. Contributors record unscripted group conversations, which are transcribed and diarized, then human-validated. As a QA Specialist, you are the final reviewer responsible for end-to-end quality of both the audio and the annotations.
Key Responsibilities
Audio Quality Assurance
- Evaluate multi-channel audio recordings against strict technical and fidelity standards.
- Verify channel isolation, confirm quiet recording environments, and flag issues such as audio bleed, clipping, or low gain.
Transcription & Diarization Verification
- Review human-validated transcriptions to ensure exceptionally high accuracy and low Word Error Rate (WER).
- Confirm transcripts accurately capture spontaneous, unnormalized speech including overlaps, interruptions, and false starts.
- Validate turn-level and word-level timestamps and speaker identification in complex, overlapping dialogue.
- Review underlying JSON-formatted data to ensure accurate metadata tagging and timestamp logic.
Metadata & Content Review
- Verify accuracy of metadata including demographic markers, contextual domains, and conversational tags.
- Audit sessions to ensure no Personally Identifying Information (PII), toxic, or sensitive content is present.
- Assign clear pass/fail or agree/disagree statuses and provide detailed, actionable feedback when disagreeing with an annotator's work.
Requirements & Qualifications
- Native proficiency in Portuguese (required).
- Exceptional ear for audio fidelity; ability to detect subtle background noise, channel bleed, or clipping.
- Meticulous attention to detail for word-level timestamps and verbatim transcription standards.
- Ability to accurately assess complex multi-speaker conversational dynamics.
Ideal Backgrounds Include:
- Linguists / Phonetics Experts: Deep understanding of natural speech patterns and complex conversational dynamics.
- Language Teachers: Native-level mastery with strict adherence to verbatim transcription guidelines.
- Professional Transcriptionists: Strong audio fidelity skills and experience meeting rigorous accuracy targets.
Engagement Details
- Type: Contractor / Freelancer (no medical or paid leave benefits)
- Duration: 15 weeks
- Commitment: Minimum 4 hours/day, 40 hours/week, with at least 4 hours of overlap with PST
- Environment: Fully remote
Evaluation Process
Shortlisted candidates will be reviewed internally by the Turing team and contacted directly for onboarding.
