Spanish Audio Evaluator Expert at Mercor

Spanish Audio Evaluator Expert | $50/hr | Worldwide Remote

Mercor is seeking a skilled Spanish (Spain) Audio Generalist Evaluator Expert to support a high-impact AI audio research project with a leading research lab. This short-term, structured engagement involves transcription, annotation, and evaluation tasks that help train and benchmark advanced language models. Ideal for candidates with strong academic or analytical backgrounds who are fluent in Peninsular Spanish and English.

Key Responsibilities

• Transcribe & Optimise Audio/Video: Listen to, analyse, and transcribe Spanish (Spain) audio and video content with strict adherence to formatting, stylistic guidelines, tone, intent, and regional language nuances.
• Define Evaluation Standards: Develop detailed rubrics and grading guidelines in both Spanish and English, documenting standards to ensure consistency across reviewers and model evaluations.
• Conduct Model Testing & Grading: Run prompts through language models, evaluate outputs for accuracy, fluency, and completeness, and provide structured feedback to improve model performance.
• Support Benchmarking & QA: Participate in quality assurance cycles, maintain dataset reliability, and collaborate with project leads to refine task design and resolve ambiguities.

Minimum Qualifications

• Native or near-native fluency in Spanish (Spain) — spoken and written — plus professional fluency in English
• Strong familiarity with Peninsular Spanish, regional vocabulary, accents, and contemporary usage
• Excellent writing, editing, and critical thinking skills
• Ability to work independently and meet deadlines
• Availability to commit 10–20 hours per week

Preferred Qualifications

• College students or recent graduates welcome
• Background in linguistics, humanities, journalism, translation/localization, or social sciences
• Prior experience with transcription, annotation, localization, or research workflows in Spanish
• Familiarity with differences between Peninsular and Latin American Spanish varieties
• Interest in AI, language models, or applied research

Application Process

Complete a short AI-led interview (approximately 15 minutes). Selected candidates will be onboarded and invited to begin project work promptly.