Generalist - AI Training & Evaluation at Mercor

Generalist - AI Training & Evaluation | $35–45/hr | Remote Worldwide

Mercor is seeking generalist experts to support a large-scale AI research project with a leading partner. This short-term, project-based opportunity involves creating and refining diverse datasets for supervised fine-tuning of frontier AI models. Ideal for professionals with strong analytical and writing capabilities who can work independently on evolving tasks.

Role Overview

Contribute to cutting-edge AI development by generating realistic prompts, evaluating AI outputs, and iterating on responses to ensure quality and alignment with human reasoning across diverse content types.

Key Responsibilities

• Create base prompts across a wide range of generalist topics
• Review and revise AI-generated responses for clarity, accuracy, and alignment
• Develop prompt-response iterations using variations in length, style, and system prompts
• Contribute to benchmarking efforts by identifying model failure points
• Apply consistent quality standards across diverse content types (summaries, Q&A, synthesis tasks)

Ideal Qualifications

• 2+ years of experience in research, education, writing, editing, or analytical fields
• Proven ability to communicate complex topics clearly and concisely
• Strong attention to detail and critical thinking skills
• Comfort working independently with evolving task guidelines
• Familiarity with LLMs or AI-assisted writing tools is a plus

Opportunity Details

• Fully remote and asynchronous—set your own schedule
• Expected commitment: 10–25 hours per week
• Project duration: approximately 2 weeks with potential for extension
• Flexible task structure with batch-based assignments

Compensation & Contract Terms

• $35–45/hour with possibility of performance bonuses
• Paid weekly via Stripe Connect
• Independent contractor classification

About Mercor

Mercor is a talent marketplace connecting top experts with leading AI labs and research organizations. Backed by Benchmark, General Catalyst, Adam D'Angelo, Larry Summers, and Jack Dorsey, thousands of professionals across domains work on frontier projects shaping the future of AI.