ML Engineer — Code & Eval Author at Mercor

ML Engineer — Code & Eval Author | $45–140/hr | Remote (Americas & Europe)

Mercor partners with frontier AI labs to build the evaluations their models are trained and measured against. In this role, you'll design ML/LLM evaluation tasks and rubrics, grade model and agent outputs, and bring your training-side expertise directly to bear on reward and eval signals that shape cutting-edge AI systems.

What You'll Do

• Design ML/LLM evaluation tasks, rubrics, and metrics for frontier AI models
• Grade model and agent outputs, improving overall eval quality through structured review
• Apply training-side judgment — including SFT, RLHF, and reward modeling — to evaluation design

What We're Looking For

• 5+ years of hands-on experience as a Machine Learning Engineer at a real product organization
• Practical experience with fine-tuning, SFT, RLHF, reward modeling, and eval metrics
• Proficiency with PyTorch or JAX, Hugging Face, and experiment tracking tools
• Strong written communication skills and the ability to articulate technical reasoning clearly

Engagement & Compensation

• Remote contract with flexible 30+ hours per week
• Hourly rate scaled to your local market: US/Canada $100–140/hr; Europe and LatAm rates adjusted to region

Hiring Process — Paid

The process includes a Mercor Technical Screen, a live Code Review Session, and a Domain Expert Interview. You'll receive $200 upon completing all three steps, regardless of the outcome.