This job post has expired on August 14, 2026. It is likely that the position has already been filled.
AI Evaluation Analyst at micro1
posted 3 months agoAI Evaluation Analyst | $20–30/hr | Worldwide Remote
Join MICRO1 as an AI Evaluation Analyst and play a key role in shaping the quality and reliability of frontier large language models (LLMs). This is a remote contractor opportunity ideal for detail-oriented professionals with a strong command of written English and a passion for AI.
About the Role
As an AI Evaluation Analyst, you will assess and annotate AI-generated outputs, ensuring they meet defined quality standards and behavioral specifications at scale. You'll work independently against detailed evaluation specs, contributing directly to the improvement of cutting-edge AI systems.
Key Responsibilities
- Evaluate and annotate outputs from frontier LLMs based on established guidelines
- Maintain high spec fidelity across large volumes of evaluation tasks
- Identify patterns in model behavior and flag inconsistencies or quality issues
- Produce clearly written, structured feedback and annotations in English
- Work independently with minimal supervision, adhering closely to detailed specifications
Required Skills
- Working knowledge of frontier LLM behavior and capabilities
- Experience with data annotation or AI/ML evaluation workflows
- Excellent written English — clarity, grammar, and structure are essential
- Ability to maintain spec fidelity at volume without sacrificing quality
- Strong self-direction and ability to follow detailed evaluation frameworks
Compensation
$20–$30/hr depending on experience and output quality.