Spanish (MX) Audio Evaluator Expert at Mercor

Spanish (MX) Audio Evaluator Expert | $50/hr | Worldwide Remote

Mercor is seeking a skilled Spanish (Mexico) Audio Generalist Evaluator Expert to support a high-impact AI audio research project with a leading research lab. This short-term, structured engagement involves transcription, annotation, and evaluation tasks that help train and benchmark advanced language models. Ideal for fluent Spanish (Mexico) speakers with strong analytical or academic backgrounds who enjoy working with audio and language data.

Key Responsibilities

• Transcribe & Optimize Audio/Video: Listen to, analyze, and transcribe Spanish (Mexico) audio and video content with strict adherence to formatting, style, and accuracy guidelines. Capture tone, intent, register, and regional Mexican Spanish nuances.
• Define Evaluation Standards: Develop detailed rubrics and grading guidelines in both Spanish and English. Document standards to ensure consistency across reviewers and identify linguistic edge cases specific to Mexican Spanish.
• Model Testing & Grading: Run prompts through language models, assess outputs against criteria for accuracy, fluency, and completeness, and provide structured feedback to improve model performance.
• Benchmarking & QA: Participate in quality assurance cycles, maintain consistency across datasets, and collaborate with project leads to refine task design before integration into official benchmarks.

Minimum Qualifications

• Native or near-native fluency in Spanish (Mexico) — spoken and written
• Professional fluency in English
• Strong familiarity with Mexican Spanish regional vocabulary, accents, and contemporary usage
• Excellent writing, editing, and critical thinking skills
• Ability to work independently and meet deadlines
• Availability to commit 10–20 hours per week

Preferred Qualifications

• College students or recent graduates welcome
• Background in linguistics, humanities, journalism, translation/localization, or social sciences
• Prior experience with transcription, annotation, localization, or research workflows in Spanish
• Familiarity with differences between Mexican Spanish and other Latin American varieties
• Interest in AI, language models, or applied research

Application Process

Complete a short AI-led interview (~15 minutes). Selected candidates will be onboarded and invited to begin project work promptly.