Posted over 30 days ago. Roles like this often stay open for a while, so it's still worth applying.
Logistics & Supply Chain AI Evaluator at Mercor
posted 3 months agoLogistics & Supply Chain AI Evaluator | $50/hr | Remote (US & Canada)
Join a cutting-edge benchmark dataset project focused on evaluating AI models for visual document understanding and instruction-following within the Logistics & Supply Chain domain. This is an exciting opportunity for domain experts to directly shape the future of AI capabilities in a highly specialized field.
What You'll Do
- Author complex, grounded tasks designed to rigorously test AI model performance on visual documents
- Define clear ground-truth outputs for each task to ensure objective evaluation
- Develop precise, objective rubrics to assess AI responses consistently and fairly
- Apply your logistics and supply chain expertise to create realistic, domain-relevant scenarios
Role Details
- Commitment: Approximately 15–20 hours per week
- Location: Fully remote — open to candidates in the US and Canada
- Rate: $50/hr
Ideal Candidate
- Strong background in Logistics, Supply Chain Management, or a closely related field
- Familiarity with document-heavy workflows (e.g., shipping manifests, invoices, purchase orders)
- Detail-oriented with the ability to craft precise, unambiguous task instructions
- Interest in AI evaluation, data annotation, or benchmark development is a plus
This is a part-time contractor engagement — perfect for seasoned professionals looking to contribute meaningfully to AI research while maintaining flexibility in their schedule.
How to apply for this role
- Upload your resume — keep it up-to-date and in English. Mercor will auto-fill your profile from it.
- Complete the AI interview — a 15-minute conversation about your experience. Be ready to discuss specific projects and challenges you've solved.
- Submit your application — only about 20% of applicants finish all the steps, so completing yours puts you well ahead.