This job post has expired on July 26, 2026. It is likely that the position has already been filled.
Real Estate Appraisal AI Evaluator at Mercor
posted 3 months agoReal Estate Appraisal AI Evaluator | $50/hr | Remote (US & Canada)
Join a specialized benchmark dataset project focused on evaluating AI models in the Real Estate Appraisal domain. This role centers on visual document understanding and instruction-following, where domain experts craft complex, grounded tasks with clear ground-truth outputs and objective evaluation rubrics.
What You'll Do
- Author high-quality, complex tasks grounded in real estate appraisal documents and visual data
- Define clear ground-truth outputs and objective scoring rubrics for AI model evaluation
- Assess AI model performance on visual document comprehension and instruction-following tasks
- Contribute to a rigorous benchmark dataset used to advance AI capabilities in the appraisal domain
Role Details
- Commitment: Approximately 15–20 hours per week
- Location: Fully remote — open to candidates in the US and Canada
- Rate: $50/hr
- Project Type: Contract/Part-Time benchmark dataset contribution
Ideal Candidate
- Professional background or expertise in real estate appraisal
- Comfortable working with visual documents such as appraisal reports, property records, and related materials
- Detail-oriented with strong analytical and written communication skills
- Interest in AI evaluation and data quality
This is a private shortlist opportunity and is not publicly listed on the general job board. Qualified candidates will be contacted directly.
How to apply for this role
- Upload your resume — keep it up-to-date and in English. Mercor will auto-fill your profile from it.
- Complete the AI interview — a 15-minute conversation about your experience. Be ready to discuss specific projects and challenges you've solved.
- Submit your application — only about 20% of applicants finish all the steps, so completing yours puts you well ahead.