Vietnamese Audio Evaluator Expert at Mercor

Vietnamese Audio Evaluator Expert | $50/hr | Worldwide Remote

Mercor is seeking a skilled Vietnamese Audio Generalist Evaluator Expert to support a high-impact AI audio research project with a leading research lab. This short-term, structured engagement is ideal for analytically minded individuals who are fluent in Vietnamese and English and have a passion for language, transcription, and AI evaluation workflows.

Key Responsibilities

• Transcribe & Analyze Audio/Video: Listen to, analyze, and transcribe Vietnamese audio and video content with high accuracy, capturing tone, intent, and regional language nuances.
• Define Evaluation Standards: Develop detailed rubrics and grading guidelines in both Vietnamese and English, documenting standards to ensure consistency across reviewers and model evaluations.
• Model Testing & Grading: Run prompts through language models, assess generated outputs against predefined criteria for accuracy, fluency, and completeness, and provide structured feedback.
• Benchmarking & QA Support: Participate in quality assurance cycles to ensure tasks and outputs meet Mercor's quality bar before integration into official benchmarks.

Minimum Qualifications

• Native or near-native fluency in Vietnamese (spoken and written) and professional fluency in English.
• Strong writing, editing, and critical thinking skills.
• Ability to work independently, manage time effectively, and meet deadlines.
• Availability to commit 10–20 hours per week.

Preferred Qualifications

• College students or recent graduates welcome.
• Background in linguistics, humanities, social sciences, journalism, or technical disciplines.
• Prior experience with transcription, annotation, localization, or research workflows in Vietnamese.
• Familiarity with Vietnamese dialectal variations and regional speech patterns.
• Interest in AI, language models, or applied research environments.

Application Process

Complete a short AI-led interview (approximately 15 minutes). Selected candidates will be onboarded and invited to begin project work promptly.

Gain hands-on exposure to real-world AI research and contribute directly to advancing multilingual language model benchmarking.