Manufacturing Domain Expert (AI Eval) at Mercor

Manufacturing Domain Expert | $25–35/hr | Worldwide Remote

Mercor is partnering with a leading AI lab to bring on experienced manufacturing professionals for an AI model evaluation project. In this role, you will assess the quality, accuracy, and safety of AI-generated responses in manufacturing contexts — directly contributing to more reliable and trustworthy AI systems in high-stakes environments.

Key Responsibilities

• Write realistic prompts that reflect how professionals and consumers seek domain-specific manufacturing guidance
• Evaluate AI-generated responses for factual accuracy, regulatory correctness, and practical usefulness
• Identify fabricated claims, incorrect references, or misleading reasoning across model outputs
• Score and rank multiple model responses using structured rubrics across key dimensions
• Provide written justifications supported by specific evidence for each evaluation

Ideal Qualifications

• Professional experience applying manufacturing expertise in a practitioner or advisory capacity
• Familiarity with industry-specific standards, regulations, and best practices
• Strong written communication and critical reasoning skills

Engagement Details

• Expected commitment: approximately 20 hours per week
• Fully remote, flexible schedule
• Hourly rate: $25–$35/hr

Application Process

Submit your resume to get started. Shortlisted candidates will be asked to complete a Model Response Evaluation assessment as part of the selection process.