Psychologist - AI Evaluation Project at Mercor

Psychologist - AI Evaluation | $30–80/hr | Remote Worldwide

Mercor is partnering with a leading AI research organization to engage experienced psychologists for a high-impact project evaluating and enhancing AI systems' performance on psychology-related tasks. This contract role offers the opportunity to apply your expertise in clinical, cognitive, developmental, and social psychology to shape the future of AI.

Key Responsibilities

• Design nuanced psychology-based tasks that reflect real-world scenarios, theories, and research applications
• Review AI-generated responses for conceptual accuracy, ethical soundness, and psychological insight
• Create benchmark answers demonstrating best-practice reasoning and clinical or academic standards
• Document model limitations and recommend improvements for psychology-related outputs
• Collaborate asynchronously with researchers and peer reviewers using structured written feedback

Ideal Qualifications

• PhD or PsyD in psychology or closely related field
• 3+ years of experience in clinical practice, academic research, teaching, or applied psychology
• Deep knowledge of psychological theory, diagnostic criteria, research methods, and ethical considerations
• Strong analytical and communication skills with ability to critique reasoning and logic
• Familiarity with academic and applied contexts across different psychology subfields

Opportunity Details

• Expected commitment: 10+ hours per week
• Tasks include open-ended reasoning, scenario-based judgment, literature synthesis, and ethics reviews
• Deliverables-driven work model with peer validation and structured quality checks

Application Process

• Submit a brief resume or LinkedIn profile detailing your psychology background and areas of expertise
• Complete a short skills questionnaire; a paid trial task may be used to assess fit
• Mercor will follow up with next steps and additional project details

About Mercor

Mercor is a talent marketplace connecting top experts with leading AI labs and research organizations. Backed by Benchmark, General Catalyst, Adam D'Angelo, Larry Summers, and Jack Dorsey, thousands of professionals across domains work on frontier projects shaping the next era of AI.