Hindi Audio Evaluator Expert at Mercor

Hindi Audio Evaluator Expert | $50/hr | San Francisco Bay Area (Remote-Flexible)

Mercor is seeking a skilled Hindi Audio Generalist Evaluator Expert to support a high-impact audio AI research project with a leading research lab. This short-term, structured engagement involves transcription, annotation, and evaluation tasks that help train and benchmark advanced language models. Ideal for fluent Hindi speakers with strong analytical backgrounds who are based in the San Francisco Bay Area.

Key Responsibilities

• Transcribe & Optimize Audio/Video: Listen to, analyze, and transcribe Hindi audio and video content with precision, capturing tone, intent, register, regional expressions, and dialectal nuances.
• Define Evaluation Standards: Develop detailed rubrics and grading guidelines in Hindi and English, documenting standards to ensure consistency across reviewers and model evaluations.
• Conduct Model Testing & Grading: Run prompts through language models, assess generated outputs for accuracy, fluency, and completeness, and provide structured feedback to improve model performance.
• Support Benchmarking & QA: Participate in quality assurance cycles, maintain dataset reliability, and collaborate with project leads to refine task design and resolve ambiguities.

Minimum Qualifications

• Native or near-native fluency in Hindi (spoken and written) and professional fluency in English.
• Strong familiarity with spoken Hindi, regional vocabulary, dialects, and contemporary usage.
• Excellent writing, editing, and critical thinking skills.
• Ability to work independently and meet deadlines; available 10–20 hours per week.
• Must be based in the San Francisco Bay Area.

Preferred Qualifications

• College students or recent graduates welcome.
• Background in linguistics, humanities, journalism, translation/localization, or related fields.
• Prior experience with transcription, annotation, or research workflows in Hindi.
• Familiarity with Hindi-English code-switching (Hinglish) and regional language variation.
• Interest in AI, language models, or applied research environments.

Application Process

Complete a short AI-led interview (approximately 15 minutes). Selected candidates will be onboarded and invited to begin project work promptly.