Audio Generalist Evaluator Expert at Mercor

Audio Generalist Evaluator Expert | $25–50/hr | Remote in Singapore

Mercor is seeking detail-oriented transcription and audio evaluation experts to contribute to a high-impact AI research project with a leading lab. This is a flexible, short-term opportunity for professionals with strong academic backgrounds and fluent Singaporean English skills who excel at creating clear, instructional content.

What You'll Do:

• Transcribe and Optimize Audio/Video: Create detailed audio transcriptions with multiple constraints and instructions from Singaporean English content
• Define Evaluation Standards: Establish high-level expectations for correct responses in general audio consumer contexts and develop comprehensive rubrics
• Conduct Model Testing: Run prompts through AI models and assess preliminary outputs against established expectations
• Quality Assurance: Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigorous standards, maintaining consistency and reliability before integration into official benchmarks

Minimum Qualifications:

• Strong writing and critical thinking skills
• Ability to work independently and meet deadlines
• Fluent in Singaporean English
• Available to work remotely, 10-20 hours per week
• Must be based in Singapore

Preferred Qualifications:

• College students or recent graduates

Project Details:

• Commitment: 10-20 hours per week for approximately 3-6 months
• Structured project environment with clear goals and tools
• Flexible remote work arrangement

Application Process:

• Complete a 15-minute AI-led interview
• If selected, you'll be invited to begin work on the project immediately