AI Data Labeling Specialist at Mercor

AI Data Labeling Specialist | $25–35/hr | Remote Worldwide

Mercor is partnering with a leading AI lab on a short-term project to enhance preference ranking models for conversational AI systems. We're looking for detail-oriented professionals with data labeling or content evaluation experience to assess and rank AI model outputs across diverse domains.

Role Overview

This remote, flexible opportunity is ideal for professionals comfortable with nuanced judgment tasks and independent work. Set your own schedule while contributing to cutting-edge AI development.

Key Responsibilities

• Evaluate and compare AI-generated responses for quality, coherence, and helpfulness
• Assign preference rankings to pairs or sets of model outputs
• Follow detailed labeling guidelines and adapt to evolving criteria
• Provide brief written explanations for ranking decisions when required
• Flag edge cases or inconsistencies in task design or model output

Ideal Qualifications

• Prior experience in data labeling, content moderation, or preference ranking tasks
• Excellent critical thinking and reading comprehension skills
• Comfort working with evolving guidelines and ambiguity
• Strong attention to detail and consistency across repetitive tasks
• Availability for 10–20 hours per week on a regular basis

Compensation & Terms

• $25–35/hour based on experience and location
• Weekly payments via Stripe Connect
• Freelance engagement as an independent contractor
• Remote and asynchronous work—set your own hours

Application Process

• Submit your resume to get started
• Complete a short form highlighting relevant experience
• Brief assessment may be required to evaluate task fit
• Expect a response within 3–5 business days

About Mercor

Mercor is a talent marketplace connecting top experts with leading AI labs and research organizations. Backed by Benchmark, General Catalyst, Adam D'Angelo, Larry Summers, and Jack Dorsey, we enable thousands of professionals to collaborate on contract-based projects shaping the future of AI.