Posted over 30 days ago. Roles like this often stay open for a while, so it's still worth applying.
Software Engineer (Code QA) at Mercor
posted 8 months agoSoftware Engineer (Code QA) | $70–120/hr | Worldwide Remote
Mercor is seeking experienced Software Engineers to support high-impact research collaborations with leading AI labs. This is a unique opportunity to apply your engineering expertise toward shaping the next generation of intelligent systems by building evaluation datasets that assess AI reasoning, explanation quality, and technical judgment in coding-related interactions.
About the Project
You'll work on creating code question and answer evaluation datasets designed to assess natural-language reasoning, explanation quality, and technical judgment in coding-related interactions. Tasks are structured as chat-pasteable prompts that reflect realistic developer questions and include all necessary context inline, such as code snippets, error messages, logs, or requirements.
Key Responsibilities
- Craft realistic developer prompts across multiple categories including code review, debugging, error diagnosis, and configuration
- Source and adapt content from real pull requests to create authentic scenarios
- Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality
Ideal Qualifications
- 2+ years of experience in software engineering, technical research, or educational content development
- Bachelor's degree in Software Engineering, Computer Science, or related field (advanced degree preferred)
- Strong proficiency in languages like Python, JavaScript, Java, or C++
- Experience with debugging, testing, and validating code
- Comfortable with technical writing and attention to detail
Project Timeline
- Start Date: Immediate
- Duration: 1-2 months
- Commitment: Part-time (15–25 hours/week, with flexibility up to 40 hours/week)
Application & Onboarding Process
- Upload your resume
- Complete a short 15-minute AI interview to discuss your background, experience, and interest in the role
- Receive follow-up communication within a few days with next steps and onboarding details
Apply today and leverage your software engineering expertise to help build the future of AI-driven systems!
How to apply for this role
- Upload your resume — keep it up-to-date and in English. Mercor will auto-fill your profile from it.
- Complete the AI interview — a 15-minute conversation about your experience. Be ready to discuss specific projects and challenges you've solved.
- Submit your application — only about 20% of applicants finish all the steps, so completing yours puts you well ahead.