Rubrics Writer / Auditor at Mercor

Rubrics Writer / Auditor | $25–45/hr | Worldwide Remote

Mercor is partnering with a leading AI lab to bring on skilled generalist writers with rubric-based evaluation experience for a short-term, project-based engagement. In this role, you'll help improve AI assistants by applying structured evaluation frameworks to assess conversational content quality and refine model performance. This is an excellent opportunity for detail-oriented writers passionate about shaping how AI systems understand nuance and quality in writing.

Key Responsibilities

• Evaluate AI-generated written conversations using predefined rubrics to assess performance
• Draft and refine evaluation rubrics for a variety of generalist writing tasks
• Apply structured scoring criteria to assess clarity, coherence, accuracy, and style
• Review edge cases and ambiguous outputs to maintain consistent grading standards

Ideal Qualifications

• Prior experience with rubric-based grading, editing, or content evaluation
• Strong generalist writing skills across multiple domains (e.g., business, academic, creative)
• Exceptional attention to detail and consistency when applying guidelines across varied contexts
• Ability to interpret nuanced criteria and exercise sound, independent judgment
• Background in English, journalism, communications, or a related field is preferred

Compensation & Contract Details

• Hourly rate: $25–$45/hr, depending on experience and location
• Short-term, project-based contract with opportunities for expanded reviewer or lead responsibilities

How to Apply

Submit your resume or a writing sample to get started. Qualified applicants will be contacted within a few days regarding next steps.