Software Engineer (Code QA) at Mercor

Software Engineer (Code QA) | $70–120/hr | Worldwide Remote

Mercor is seeking experienced Software Engineers to support high-impact research collaborations with leading AI labs. This is a unique opportunity to apply your engineering expertise toward shaping the next generation of intelligent systems by building evaluation datasets that assess AI reasoning, explanation quality, and technical judgment in coding-related interactions.

About the Project

You'll work on creating code question and answer evaluation datasets designed to assess natural-language reasoning, explanation quality, and technical judgment in coding-related interactions. Tasks are structured as chat-pasteable prompts that reflect realistic developer questions and include all necessary context inline, such as code snippets, error messages, logs, or requirements.

Key Responsibilities

• Craft realistic developer prompts across multiple categories including code review, debugging, error diagnosis, and configuration
• Source and adapt content from real pull requests to create authentic scenarios
• Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality

Ideal Qualifications

• 2+ years of experience in software engineering, technical research, or educational content development
• Bachelor's degree in Software Engineering, Computer Science, or related field (advanced degree preferred)
• Strong proficiency in languages like Python, JavaScript, Java, or C++
• Experience with debugging, testing, and validating code
• Comfortable with technical writing and attention to detail

Project Timeline

• Start Date: Immediate
• Duration: 1-2 months
• Commitment: Part-time (15–25 hours/week, with flexibility up to 40 hours/week)

Application & Onboarding Process

1. Upload your resume
2. Complete a short 15-minute AI interview to discuss your background, experience, and interest in the role
3. Receive follow-up communication within a few days with next steps and onboarding details

Apply today and leverage your software engineering expertise to help build the future of AI-driven systems!