Posted over 30 days ago. Roles like this often stay open for a while, so it's still worth applying.
Generalist Expert at Mercor
posted 4 months agoGeneralist Expert | $70/hr | Worldwide Remote
Join a high-impact AI research initiative where your analytical skills directly shape the quality of next-generation AI systems. In this role, you will evaluate AI-generated responses and deliver structured, well-reasoned written feedback to help improve model performance and reliability.
What You'll Do
- Review and assess AI-generated responses for accuracy, reasoning quality, and nuance
- Write clear, precise, and well-evidenced evaluation rationales that go beyond surface-level observations
- Apply structured evaluation guidelines consistently and accurately
- Provide honest, critical assessments when warranted — even when that means delivering tough feedback
Basic Qualifications
- Bachelor's degree from a top-500 globally ranked university (preferred)
- Strong analytical and written communication skills
- Ability to work independently and follow detailed task guidelines
- Native English fluency required
Required Skills
- Strong critical reading ability — identifying nuance, implicit meaning, and gaps in reasoning
- Exceptional written communication with the ability to craft precise, evidence-backed rationales
- Consistent, unbiased judgment and intellectual honesty
- Strict attention to detail and accurate application of evaluation frameworks
- Must be able to complete all work entirely without AI writing assistance
This is an excellent opportunity for sharp, detail-oriented thinkers looking to contribute meaningfully to cutting-edge AI research on a flexible, hourly basis.
How to apply for this role
- Upload your resume — keep it up-to-date and in English. Mercor will auto-fill your profile from it.
- Complete the AI interview — a 15-minute conversation about your experience. Be ready to discuss specific projects and challenges you've solved.
- Submit your application — only about 20% of applicants finish all the steps, so completing yours puts you well ahead.