Logistics & Supply Chain AI Evaluator at Mercor

Logistics & Supply Chain AI Evaluator | $50/hr | Remote (US & Canada)

Join a cutting-edge benchmark dataset project focused on evaluating AI models for visual document understanding and instruction-following within the Logistics & Supply Chain domain. This is an exciting opportunity for domain experts to directly shape the future of AI capabilities in a highly specialized field.

What You'll Do

• Author complex, grounded tasks designed to rigorously test AI model performance on visual documents
• Define clear ground-truth outputs for each task to ensure objective evaluation
• Develop precise, objective rubrics to assess AI responses consistently and fairly
• Apply your logistics and supply chain expertise to create realistic, domain-relevant scenarios

Role Details

• Commitment: Approximately 15–20 hours per week
• Location: Fully remote — open to candidates in the US and Canada
• Rate: $50/hr

Ideal Candidate

• Strong background in Logistics, Supply Chain Management, or a closely related field
• Familiarity with document-heavy workflows (e.g., shipping manifests, invoices, purchase orders)
• Detail-oriented with the ability to craft precise, unambiguous task instructions
• Interest in AI evaluation, data annotation, or benchmark development is a plus

This is a part-time contractor engagement — perfect for seasoned professionals looking to contribute meaningfully to AI research while maintaining flexibility in their schedule.