Posted over 30 days ago. Roles like this often stay open for a while, so it's still worth applying.
Image Evaluator Expert at Mercor
posted 7 months agoImage Evaluator Expert | $20–25/hr | Worldwide Remote | Part-Time Contract
Mercor is partnering with a leading AI lab to recruit detail-oriented image evaluation specialists. In this role, you will assess AI-powered image editing systems, helping improve the quality, safety, and reliability of cutting-edge multimodal models. This is a flexible, project-based opportunity ideal for professionals with strong visual judgment and structured evaluation skills.
Key Responsibilities
- Review original images, user edit instructions, and AI-generated edited outputs
- Conduct pre-evaluation feasibility checks to confirm instructions are valid and achievable
- Flag unsafe, harmful, or policy-violating content in edited images
- Assess instruction adherence, structural integrity, and preservation of unedited areas
- Evaluate visual quality, style alignment, and character consistency
- Provide structured ratings across defined grading dimensions
- Deliver clear, consistent evaluations following detailed rubric guidelines
Ideal Qualifications
- Background in image review, visual quality assurance, content moderation, or related fields
- Strong attention to detail with the ability to identify subtle visual inconsistencies
- Familiarity with image editing concepts, digital art, or generative AI systems
- Ability to apply structured evaluation rubrics consistently and objectively
- Clear written communication skills for documenting assessments
- Comfort reviewing a wide range of visual content, including potentially sensitive material
Application Process
- Submit your resume or professional background to express interest
- Complete a short screening assessment to demonstrate your evaluation skills
- Selected candidates will receive detailed project guidelines and next steps
- Expect communication regarding your status within a few business days
How to apply for this role
- Upload your resume — keep it up-to-date and in English. Mercor will auto-fill your profile from it.
- Complete the AI interview — a 15-minute conversation about your experience. Be ready to discuss specific projects and challenges you've solved.
- Submit your application — only about 20% of applicants finish all the steps, so completing yours puts you well ahead.