AI Evaluation Analyst at micro1

AI Evaluation Analyst | $20–30/hr | Worldwide Remote

Join MICRO1 as an AI Evaluation Analyst and play a key role in shaping the quality and reliability of frontier large language models (LLMs). This is a remote contractor opportunity ideal for detail-oriented professionals with a strong command of written English and a passion for AI.

About the Role

As an AI Evaluation Analyst, you will assess and annotate AI-generated outputs, ensuring they meet defined quality standards and behavioral specifications at scale. You'll work independently against detailed evaluation specs, contributing directly to the improvement of cutting-edge AI systems.

Key Responsibilities

• Evaluate and annotate outputs from frontier LLMs based on established guidelines
• Maintain high spec fidelity across large volumes of evaluation tasks
• Identify patterns in model behavior and flag inconsistencies or quality issues
• Produce clearly written, structured feedback and annotations in English
• Work independently with minimal supervision, adhering closely to detailed specifications

Required Skills

• Working knowledge of frontier LLM behavior and capabilities
• Experience with data annotation or AI/ML evaluation workflows
• Excellent written English — clarity, grammar, and structure are essential
• Ability to maintain spec fidelity at volume without sacrificing quality
• Strong self-direction and ability to follow detailed evaluation frameworks

Compensation

$20–$30/hr depending on experience and output quality.