Professional Services Practice Reviewer at Mercor

Professional Services Practice Reviewer | $70–$85/hr | Worldwide Remote

Mercor is seeking experienced, working professionals to audit AI-generated work product in their own field. This is not a content creation role — it's a critical review role where your real-world expertise is the product.

You'll evaluate an AI agent's complete attempt at a realistic professional task: the original brief, the agent's output, the files it produced, and an AI-generated scoresheet. Your job is to apply practitioner-level judgment across four key questions.

Your Responsibilities

• Task Realism: Is this a task that would genuinely arise in this profession, described accurately?
• Domain Accuracy: Are the standards, figures, regulations, and constraints correct — or is something subtly wrong that only a practitioner would catch?
• Grading Review: The AI grader answered eleven yes/no questions about the work. You review those judgments with the files open and flag any disagreements with clear reasoning.
• Score Validation: Band the work yourself — could a practitioner use or accept it? Then assess whether the reported score is defensible.

Each review takes approximately one hour per item. You never redo or replicate the agent's work.

Who We're Looking For

We are hiring across five professional tracks — apply only to the one that genuinely reflects your background:

• Project Management Specialists: 5+ years managing real project plans, schedules, and budgets. PMP a plus.
• Lawyers: US-qualified, 4+ years post-admission, actively drafting your own documents.
• Accountants & Auditors: 4+ years owning a close, audit file, or financial statements. CPA or CA strongly preferred.
• Software Developers: 3+ years shipping production code maintained by other engineers.
• IT/Systems Managers: 4+ years owning an IT function, its budget, and vendor relationships.

Ideal Candidate Profile

• Has reviewed a junior's work product, signed an audit opinion, led a meaningful code review, or participated in a project post-mortem
• Near-native business English proficiency — you'll write a concise rationale for every judgment
• Comfortable working with spreadsheets and PDFs to verify whether numbers reconcile

Less of a fit: candidates who managed a function without producing its core artifacts, or those with certifications but no delivery history.