Basque Audio Evaluator Expert at Mercor

Basque Audio Evaluator Expert | $50/hr | Worldwide Remote

Mercor is seeking a skilled Basque Audio Generalist Evaluator Expert to support a high-impact audio AI research project with a leading research lab. This short-term, structured engagement involves transcription, annotation, and evaluation tasks that help train and benchmark advanced language models. Ideal for fluent Basque (Euskara) speakers with strong analytical backgrounds who are available 10–20 hours per week.

Key Responsibilities

• Transcribe & Analyze Audio/Video: Listen to, analyze, and transcribe Basque-language content with strict adherence to formatting, stylistic guidelines, and nuanced language features including tone, register, dialectal variations, and regional expressions.
• Define Evaluation Standards: Develop detailed rubrics and grading guidelines in both Basque and English, documenting standards to ensure consistency across reviewers and model evaluations.
• Model Testing & Grading: Run prompts through language models, assess generated outputs for accuracy, fluency, and completeness, and provide structured feedback to improve model performance.
• Benchmarking & QA: Participate in quality assurance cycles, maintain dataset reliability, and collaborate with project leads to refine task design and resolve ambiguities.

Minimum Qualifications

• Native or near-native fluency in Basque (spoken and written) and professional fluency in English.
• Strong familiarity with spoken Basque, regional vocabulary, dialects (euskalkiak), and contemporary usage.
• Excellent writing, editing, and critical thinking skills.
• Ability to work independently, manage time effectively, and meet deadlines.
• Availability to commit 10–20 hours per week.

Preferred Qualifications

• College students or recent graduates welcome.
• Background in linguistics, humanities, journalism, translation/localization, or related fields.
• Prior experience with transcription, annotation, or localization workflows in Basque.
• Familiarity with Standard Basque (Euskara Batua) vs. regional dialect differences.
• Interest in AI, language models, or applied research environments.

Application Process

Complete a short AI-led interview (~15 minutes). Selected candidates will be onboarded and invited to begin project work promptly.