Malay Audio Evaluator Expert at Mercor

Malay Audio Evaluator Expert | $50/hr | Worldwide Remote

Mercor is seeking a skilled Malay Audio Generalist Evaluator Expert to support a high-impact audio AI research project with a leading research lab. This short-term, structured engagement involves transcription, annotation, and evaluation tasks that help train and benchmark advanced multilingual language models. Ideal for fluent Malay and English speakers with strong analytical backgrounds, this role offers 10–20 hours per week of flexible, remote work.

Key Responsibilities

• Transcribe & Optimise Audio/Video: Listen to, analyse, and transcribe Malay-language audio and video content with strict adherence to formatting, stylistic guidelines, and nuanced language details such as tone, intent, and regional variations.
• Define Evaluation Standards: Develop clear rubrics and grading guidelines in both Malay and English, document standards for consistency, and identify edge cases and linguistic complexities specific to Malay.
• Model Testing & Grading: Run prompts through language models, assess outputs for accuracy, fluency, and completeness, and provide structured feedback to improve model performance in Malay audio tasks.
• Benchmarking & Quality Assurance: Participate in QA and review cycles, maintain dataset consistency, and collaborate with project leads to refine task design and resolve ambiguities.

Minimum Qualifications

• Native or near-native fluency in Malay (spoken and written) and professional fluency in English.
• Strong writing, editing, and critical thinking skills.
• Ability to accurately transcribe and analyse Malay audio across general consumer contexts.
• Self-directed with strong time management and ability to meet deadlines.
• Availability to commit 10–20 hours per week.

Preferred Qualifications

• College students or recent graduates welcome.
• Background in linguistics, humanities, social sciences, journalism, or technical disciplines.
• Prior experience in transcription, annotation, localisation, or research workflows in Malay.
• Familiarity with Malay dialectal variations, regional speech patterns, and contemporary usage.
• Interest in AI, language models, or applied research environments.

Application Process

Complete a short AI-led interview (approximately 15 minutes). Selected candidates will be onboarded and invited to begin project work promptly.

Gain hands-on exposure to real-world AI research and contribute directly to advancing multilingual language model benchmarking.