Posted over 30 days ago. Roles like this often stay open for a while, so it's still worth applying.
Indonesian Audio Evaluator Expert at Mercor
posted 7 months agoIndonesian Audio Evaluator Expert | $50/hr | Worldwide Remote
Mercor is partnering with a leading AI research lab to find a skilled Indonesian Audio Generalist Evaluator Expert. This short-term, part-time engagement (10–20 hrs/week) involves transcription, annotation, and evaluation tasks that directly improve advanced multilingual language models. Ideal for fluent Indonesian speakers with strong analytical skills and an interest in AI research.
Key Responsibilities
- Transcribe & Analyze Audio/Video: Listen to and transcribe Indonesian-language audio and video content with high accuracy, capturing tone, intent, and regional language nuances.
- Define Evaluation Standards: Develop detailed rubrics and grading guidelines in both Indonesian and English, documenting standards to ensure consistency across reviewers.
- Model Testing & Grading: Run prompts through language models, evaluate outputs for accuracy, fluency, and completeness, and provide structured feedback to improve model performance.
- Benchmarking & QA: Participate in quality assurance cycles, maintain dataset reliability, and collaborate with project leads to refine task design.
Minimum Qualifications
- Native or near-native fluency in Indonesian (spoken and written) and professional fluency in English.
- Strong writing, editing, and critical thinking skills.
- Ability to work independently, manage time effectively, and meet deadlines.
- Available to commit 10–20 hours per week.
Preferred Qualifications
- College students or recent graduates welcome.
- Background in linguistics, humanities, social sciences, journalism, or technical fields.
- Prior experience with transcription, annotation, localization, or research workflows in Indonesian.
- Familiarity with Indonesian dialectal variations and contemporary usage.
- Interest in AI, language models, or applied research environments.
Application Process
Complete a short AI-led interview (~15 minutes). Selected candidates will be onboarded and invited to begin project work promptly.
Gain hands-on exposure to real-world AI research and contribute directly to benchmarking advanced multilingual language models.
How to apply for this role
- Upload your resume — keep it up-to-date and in English. Mercor will auto-fill your profile from it.
- Complete the AI interview — a 15-minute conversation about your experience. Be ready to discuss specific projects and challenges you've solved.
- Submit your application — only about 20% of applicants finish all the steps, so completing yours puts you well ahead.