Real Estate Appraisal AI Evaluator at Mercor

Real Estate Appraisal AI Evaluator | $50/hr | Remote (US & Canada)

Join a specialized benchmark dataset project focused on evaluating AI models in the Real Estate Appraisal domain. This role centers on visual document understanding and instruction-following, where domain experts craft complex, grounded tasks with clear ground-truth outputs and objective evaluation rubrics.

What You'll Do

• Author high-quality, complex tasks grounded in real estate appraisal documents and visual data
• Define clear ground-truth outputs and objective scoring rubrics for AI model evaluation
• Assess AI model performance on visual document comprehension and instruction-following tasks
• Contribute to a rigorous benchmark dataset used to advance AI capabilities in the appraisal domain

Role Details

• Commitment: Approximately 15–20 hours per week
• Location: Fully remote — open to candidates in the US and Canada
• Rate: $50/hr
• Project Type: Contract/Part-Time benchmark dataset contribution

Ideal Candidate

• Professional background or expertise in real estate appraisal
• Comfortable working with visual documents such as appraisal reports, property records, and related materials
• Detail-oriented with strong analytical and written communication skills
• Interest in AI evaluation and data quality

This is a private shortlist opportunity and is not publicly listed on the general job board. Qualified candidates will be contacted directly.