AI Rater Guidelines Writer at Mercor

AI Rater Guidelines Writer (Linguist / Instructional Designer) | $45–65/hr | Remote in US | Part-Time (35+ hrs/week)

Join a leading AI lab's GenAI team and play a foundational role in shaping the next generation of Large Language Models. We're looking for experienced Linguists and Instructional Designers who excel at transforming ambiguous program requirements into precise, rater-ready guidelines — spanning domains like finance, retail, insurance, legal, and sports.

This is a W-2 employment position with Cincinnatus LLC, with placement directly within a top-tier AI lab's extended workforce.

Key Responsibilities

• Bridge the gap between ambiguous program requirements and clear, actionable rater instructions across diverse subject-matter domains.
• Design unambiguous rating guidelines and rubrics that raters can apply consistently, including in edge cases.
• Evaluate and revise draft guidelines to eliminate ambiguity, internal contradictions, and coverage gaps.
• Translate domain-specific specifications (finance, retail, insurance, legal, sports) into precise rater instructions.
• Collaborate with subject matter experts and program leads to ensure consistency and accuracy across guideline sets.

Core Qualifications

• 3+ years of professional experience in linguistics, instructional design, technical writing, or a closely related field.
• Direct experience writing or refining guidelines/rubrics for human raters in a GenAI or RLHF context.
• Demonstrated ability to work across multiple domains and translate nuanced, domain-specific content into clear instructions.
• Strong track record of resolving ambiguity and contradiction in written specifications — concrete before/after examples are a plus.
• Availability to engage reliably for at least 35 hours/week on weekdays.
• Excellent written communication skills with the ability to convey complex guidance clearly and precisely.

Cincinnatus LLC is an Equal Employment Opportunity employer committed to fostering an inclusive and diverse workplace.