Government/Non-Profit Domain Expert at Mercor

Government/Non-Profit Domain Expert | $25–$35/hr | Worldwide Remote

Mercor is partnering with a leading AI lab to bring on experienced professionals for an AI model evaluation project focused on government and non-profit subject matter. This is a flexible, part-time contractor role (~20 hrs/week) where your expertise directly improves the accuracy and reliability of AI systems in high-stakes environments.

Key Responsibilities

• Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance
• Evaluate AI-generated responses for factual accuracy, regulatory correctness, and practical usefulness
• Identify fabricated claims, incorrect references, or misleading reasoning in model outputs
• Score and rank multiple model responses using structured rubrics across key dimensions
• Provide written justifications with specific evidence to support each evaluation

Ideal Qualifications

• Professional experience applying domain expertise in a practitioner or advisory capacity within government or non-profit sectors
• Familiarity with industry-specific standards, regulations, or compliance guidelines
• Strong written communication and critical reasoning skills

Application Process

1. Submit your resume to begin
2. Complete the Model Response Evaluation assessment

This is a meaningful opportunity to shape how AI handles sensitive, real-world information in the public sector.