Posted over 30 days ago. Roles like this often stay open for a while, so it's still worth applying.
UI / UX Design Expert at Mercor
posted 3 months agoUI / UX Design Expert | $80–150/hr | Worldwide Remote
Mercor is partnering with a leading AI research organization to bring on experienced UI/UX and product designers for an evaluation-focused project. Rather than producing design deliverables, you will define what excellent design work looks like — crafting grading criteria and scoring AI-generated and human work samples with rigorous, well-reasoned written justifications.
Key Responsibilities
- Design precise, task-specific grading criteria for real-world digital product and UX deliverables, including design systems, responsive UI layouts, dashboards, end-to-end product flows (onboarding, checkout, booking), customer portals, UX writing, and design-to-engineering handoff
- Score AI-generated and human work samples against defined criteria, providing detailed written justifications for every score
- Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible
- Incorporate structured feedback from senior reviewers and iterate quickly on your evaluations
Ideal Qualifications
- 5+ years of professional experience in product design, UI/UX, or design systems for real digital products (not brand or marketing sites)
- Background at leading digital-product studios, in-house product-design teams at major product-led companies, or e-commerce/marketplace companies with sophisticated portals and dashboards
- Experience in one or more tracks: Product/UI/Design Systems Designer, UX Lead, UX Writer/Content Designer, or digital Product/Business Analyst
- Deep fluency in interaction and visual design, design systems, responsive layouts, end-to-end product flows, prototyping, and production handoff in Figma
- Exceptionally strong written communication — able to articulate precisely why work does or does not meet the bar for a real product and its users
- Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers
- Prior experience with AI training, evaluation, or human-data projects is a strong plus
Application Process
Submit your resume, portfolio, or relevant professional background to get started. Qualified applicants may be asked to complete a brief assessment or provide additional information.
How to apply for this role
- Upload your resume — keep it up-to-date and in English. Mercor will auto-fill your profile from it.
- Complete the AI interview — a 15-minute conversation about your experience. Be ready to discuss specific projects and challenges you've solved.
- Submit your application — only about 20% of applicants finish all the steps, so completing yours puts you well ahead.