QA / Software Engineering Reviewer at Mercor

QA / Software Engineering Reviewer | $30–60/hr | Worldwide Remote

Mercor is looking for experienced Software Engineers, QA Engineers, SDETs, and Test Automation Engineers to review browser-based evaluation workflows for AI-generated web applications. In this role, you'll ensure that browser tests are technically sound, deterministic, and capable of producing clear pass/fail outcomes before they're incorporated into benchmark datasets.

What You'll Do

• Review browser-based testing workflows for AI-generated web applications.
• Assess whether browser interactions are technically feasible and reliable.
• Validate test isolation, fixtures, setup, and execution flow.
• Ensure assertions produce deterministic, unambiguous pass/fail results.
• Identify flaky tests, hidden dependencies, or ambiguous validation logic.
• Provide structured technical feedback following project review rubrics.

What We're Looking For

• 3+ years of experience in Software Engineering, QA Engineering, SDET, or Test Automation.
• Strong experience testing modern web applications.
• Familiarity with browser automation frameworks such as Playwright, Cypress, Selenium, or similar tools.
• Experience writing automated UI and end-to-end tests.
• Solid understanding of test isolation, fixtures, reproducibility, and reliable browser automation.
• Excellent debugging skills and sharp attention to detail.

Why Join?

• Contribute directly to the development of AI systems by ensuring evaluation workflows are robust and reliable.
• Work on realistic web application testing scenarios involving automation, test design, and software quality engineering.
• Collaborate with a high-calibre team helping define quality standards for AI-generated software evaluation.