This job post has expired on December 09, 2025. It is likely that the position has already been filled.
AI Data Labeling Specialist at Mercor
posted 11 months agoAI Data Labeling Specialist | $25–35/hr | Remote Worldwide
Mercor is partnering with a leading AI lab on a short-term project to enhance preference ranking models for conversational AI systems. We're looking for detail-oriented professionals with data labeling or content evaluation experience to assess and rank AI model outputs across diverse domains.
Role Overview
This remote, flexible opportunity is ideal for professionals comfortable with nuanced judgment tasks and independent work. Set your own schedule while contributing to cutting-edge AI development.
Key Responsibilities
- Evaluate and compare AI-generated responses for quality, coherence, and helpfulness
- Assign preference rankings to pairs or sets of model outputs
- Follow detailed labeling guidelines and adapt to evolving criteria
- Provide brief written explanations for ranking decisions when required
- Flag edge cases or inconsistencies in task design or model output
Ideal Qualifications
- Prior experience in data labeling, content moderation, or preference ranking tasks
- Excellent critical thinking and reading comprehension skills
- Comfort working with evolving guidelines and ambiguity
- Strong attention to detail and consistency across repetitive tasks
- Availability for 10–20 hours per week on a regular basis
Compensation & Terms
- $25–35/hour based on experience and location
- Weekly payments via Stripe Connect
- Freelance engagement as an independent contractor
- Remote and asynchronous work—set your own hours
Application Process
- Submit your resume to get started
- Complete a short form highlighting relevant experience
- Brief assessment may be required to evaluate task fit
- Expect a response within 3–5 business days
About Mercor
Mercor is a talent marketplace connecting top experts with leading AI labs and research organizations. Backed by Benchmark, General Catalyst, Adam D'Angelo, Larry Summers, and Jack Dorsey, we enable thousands of professionals to collaborate on contract-based projects shaping the future of AI.
How to apply for this role
- Upload your resume — keep it up-to-date and in English. Mercor will auto-fill your profile from it.
- Complete the AI interview — a 15-minute conversation about your experience. Be ready to discuss specific projects and challenges you've solved.
- Submit your application — only about 20% of applicants finish all the steps, so completing yours puts you well ahead.