Traditional Chinese AI Evaluator Expert at Mercor

Traditional Chinese AI Language Expert | $25–30/hr | Remote in Taiwan

Mercor is seeking native Traditional Chinese speakers with exceptional writing skills to contribute to a high-impact AI research project with a leading lab. This short-term, flexible opportunity is ideal for language professionals who can create bilingual prompt-response pairs that train and evaluate advanced language models while maintaining cultural authenticity and technical precision.

What You'll Do:

• Multilingual Prompt Design: Create detailed prompts in Traditional Chinese and English with multiple constraints, ensuring natural phrasing and real-world relevance for Traditional Chinese-speaking users
• Evaluation Standards: Establish high-level expectations for correct responses in Traditional Chinese contexts and develop comprehensive rubrics that account for linguistic nuance, tone, and cultural conventions
• Model Testing & Grading: Run prompts through AI models and assess outputs for accuracy, fluency, and cultural fit in Traditional Chinese, comparing results against English benchmarks
• Quality Assurance: Collaborate in QA review processes to ensure prompt tasks and rubrics maintain consistency and reliability across Traditional Chinese-language benchmarks

Minimum Qualifications:

• Native-level fluency in Traditional Chinese (written) with strong reading/writing ability in English
• BS or BA from a reputable institution (completed or in progress)
• Strong writing and critical thinking skills with ability to work independently
• Significant familiarity with ChatGPT or similar AI tools
• Based in Taiwan or able to reliably produce Taiwan-specific, culturally accurate Traditional Chinese content

Preferred Qualifications:

• Experience in teaching, research, editing, or academic writing
• Experience creating evaluation criteria, rubrics, or grading guidelines
• Familiarity with large language models, prompting, or model evaluation

Project Details:

• Commitment: At least 20 hours per week for approximately 2+ months
• Application process: 15-minute AI-led interview followed by 45-minute written assessment
• Structured project environment with clear goals and tools

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.