Generalist Image Evaluation Expert (Remote) at Mercor

Generalist Image Evaluation Expert (Remote)

Hourly Rate: $54/hr
Location: Fully Remote (Must be based in the U.S. or Canada)

Role Overview

Mercor is seeking a detail-oriented Generalist Image Evaluation Expert to join our AI project focused on generating accurate, high-quality annotations for image-prompt pairs. In this role, you will create detailed, ground-truth responses aligned with specific quality metrics, directly influencing the training and fine-tuning of cutting-edge AI systems.

Key Responsibilities

• Evaluate image-prompt pairs and write precise, high-quality annotations following predefined standards.

• Ensure annotations fulfill nine key quality attributes including accuracy, clarity, completeness, and relevance.

• Review and refine annotations for logical consistency and compliance with project guidelines.

• Work collaboratively and asynchronously with the project team, adhering to internal workflows.

• Track your progress and proactively flag any ambiguities or inconsistencies.

Ideal Qualifications

• Proven experience in content evaluation, annotation, academic writing, or AI/ML data labeling.

• Exceptional attention to detail, critical thinking skills, and adherence to structured guidelines.

• Experience evaluating or generating image-related content is a plus.

• Self-motivated, able to manage tasks independently and effectively within a remote, asynchronous work environment.

Minimum Requirements

• Master's degree or higher in a relevant field (e.g., Communication, Linguistics, Education, Data Science).

• 2+ years of relevant professional experience.

• Strong English writing proficiency.

• Must reside in the U.S. or Canada.

Additional Role Details

• Fully remote, flexible, and asynchronous schedule.

• Estimated workload of approximately 5–10 hours per week.

• Clearly defined project expectations and guidelines.

Application Process

• Submit your resume.

• Participate in a brief (10-minute) AI-led interview assessing your research and reasoning skills.

• Expect a decision or follow-up within a few days, followed by prompt onboarding.

About Mercor

Mercor, headquartered in San Francisco, CA, specializes in connecting top experts with elite AI research labs. Our notable investors include Benchmark, General Catalyst, Adam D’Angelo, Larry Summers, and Jack Dorsey.

Apply now to make a direct impact on the development of innovative AI systems!