Danish Audio Evaluator Expert at Mercor

Danish Audio Evaluator Expert | $25–50/hr | London or San Francisco In-Person

Mercor is seeking a Danish Audio Generalist Evaluator Expert to contribute to a high-impact audio AI research project with a leading research lab. This short-term, structured engagement (3–6 months) is ideal for candidates with strong academic or analytical backgrounds who are fluent in Danish and English. You'll work on transcription, annotation, and evaluation tasks that help train and benchmark advanced language models.

This role requires regular in-person work at Mercor's San Francisco or London office.

Job Responsibilities

• Transcribe and Optimize Audio & Video: Listen to, analyze, and transcribe audio and video content in Danish, following detailed constraints and instructions. Produce high-quality written outputs with supporting work in English when required.
• Define and Document Evaluation Standards: Establish clear expectations for correct and high-quality responses in general consumer audio contexts. Develop detailed evaluation rubrics and grading guidelines in Danish and English.
• Conduct Model Testing and Grading: Run prompts through language models and assess generated outputs. Evaluate responses against predefined criteria for accuracy, completeness, and instructional clarity.
• Support Benchmarking and Quality Assurance: Participate in QA and review cycles to ensure tasks, rubrics, and outputs meet quality standards. Collaborate with project leads to resolve ambiguities and improve task design.

Minimum Qualifications

• Strong writing, editing, and critical thinking skills
• Ability to work independently, manage time effectively, and meet deadlines
• Fluency in Danish and English (spoken and written)
• Available to commit 10–20 hours per week
• Able to work within GMT or PST-aligned working hours

Preferred Qualifications

• College students or recent graduates
• Background in linguistics, humanities, social sciences, or technical fields
• Prior experience with transcription, annotation, evaluation, or research workflows
• Interest in AI, language models, or applied research environments

Application & Onboarding Process

Complete a short AI-led interview (approximately 15 minutes). If selected, you will be onboarded and invited to begin project work.

Additional Role Details

Expected project duration: 3–6 months. You will work in a structured, goal-oriented project environment with clear tooling, guidelines, and support. This role provides hands-on exposure to real-world AI research and evaluation workflows.