Video Evaluation Generalist at Mercor

Video Evaluation Generalist | $15–20/hr | Worldwide Remote

Mercor is hiring detail-oriented professionals to support a high-impact video AI research project in collaboration with a leading lab. In this role, you will evaluate short video clips by comparing paired outputs against structured rubrics — helping shape the future of AI-generated video quality.

This is a short-term, flexible opportunity ideal for individuals with strong academic backgrounds, sharp critical thinking skills, and a passion for structured analysis.

Key Responsibilities

• Evaluate Paired Video Outputs: Watch two short video clips side by side and assess them across dimensions including prompt adherence, motion quality, visual artifacts, and physical plausibility.
• Score and Justify Preferences: Assign rubric-based scores to each clip, select an overall preference, and provide concise written justifications where required.
• Maintain Scoring Consistency: Apply uniform standards across high task volumes to ensure reliable, calibrated, and comparable judgments throughout the project.

Minimum Qualifications

• Bachelor's degree (BS or BA) from a reputable institution — completed or in progress
• Strong writing and critical thinking abilities
• Ability to work independently and meet deadlines

Preferred Qualifications

• 2+ years of experience in teaching or research

Project Details

• Commitment of at least 20 hours per week
• Expected duration of approximately 1.5 weeks
• Structured project environment with clear goals and tools provided

Application Process

Complete a brief AI-led interview (approximately 15 minutes). Qualified candidates will be invited to join the project shortly after.