Japanese Audio Evaluator Expert at Mercor

Japanese Audio Evaluator Expert | $50/hr | Worldwide Remote

Mercor is seeking a skilled Japanese Audio Generalist Evaluator Expert to support a high-impact audio AI research project with a leading research lab. This short-term, structured engagement involves transcription, annotation, and evaluation tasks that help train and benchmark advanced language models. Ideal for candidates with strong academic or analytical backgrounds who are fluent in Japanese and English.

Key Responsibilities

• Transcribe & Optimise Audio/Video: Listen to, analyse, and transcribe Japanese audio and video content with high accuracy, capturing tone, intent, register, honorifics, regional dialects, and spoken variations.
• Define Evaluation Standards: Develop detailed rubrics and grading guidelines in both Japanese and English, documenting standards to ensure consistency across reviewers and model evaluations.
• Conduct Model Testing & Grading: Run prompts through language models, evaluate outputs for accuracy, fluency, and completeness, and provide structured feedback to improve Japanese audio task performance.
• Support Benchmarking & QA: Participate in quality assurance cycles, maintain consistency across datasets, and collaborate with project leads to refine task design and resolve ambiguities.

Minimum Qualifications

• Native or near-native fluency in Japanese (spoken and written) and professional fluency in English.
• Strong familiarity with spoken Japanese, regional dialects, and honorific systems (keigo).
• Excellent writing, editing, and critical thinking skills.
• Ability to work independently, manage time effectively, and meet deadlines.
• Availability to commit 10–20 hours per week.

Preferred Qualifications

• College students or recent graduates welcome.
• Background in linguistics, humanities, journalism, translation/localization, or related fields.
• Prior experience with transcription, annotation, localization, or research workflows in Japanese.
• Familiarity with regional dialects across Japan.
• Interest in AI, language models, or applied research environments.

Application Process

Complete a short AI-led interview (approximately 15 minutes). Selected candidates will be onboarded and invited to begin project work promptly.