Benture logo
 ←  next job →

AI Red-Teamer — Adversarial Testing at Mercor

posted 23 days ago
mercor.com Contractor remote: US/EG/SA/AE $32.25/hr 178 views

AI Red-Teamer — Adversarial Testing | $32.25/hr | Remote (US, Egypt, Saudi Arabia, UAE) | English & Arabic Required

Join Mercor's elite red team to probe AI systems, uncover vulnerabilities, and generate critical safety data that makes AI more secure for our customers. This role combines adversarial testing expertise with structured documentation to strengthen AI defenses before deployment.

Why This Role Matters

At Mercor, we believe the safest AI is one that's already been attacked — by us. You'll be part of a specialized team of human data experts who surface vulnerabilities through adversarial inputs and create the red team datasets that protect AI systems in production. This text-based work involves reviewing AI outputs on sensitive topics including bias, misinformation, and harmful behaviors. Participation in higher-sensitivity projects is optional and supported by clear guidelines and wellness resources.

What You'll Do

  • Conduct red team testing on conversational AI models: jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
  • Generate high-quality human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
  • Apply structured methodologies using taxonomies, benchmarks, and playbooks to ensure consistent testing
  • Document findings reproducibly with detailed reports, datasets, and attack cases that customers can act on

Required Qualifications

  • Native-level fluency in both English and Arabic
  • Prior red teaming experience (AI adversarial work, cybersecurity, or socio-technical probing)
  • Adversarial mindset with instinct to push systems to breaking points
  • Structured approach using frameworks and benchmarks, not just random testing
  • Strong communication skills to explain risks to technical and non-technical stakeholders
  • Adaptability to move across diverse projects and customers

Valuable Specialties

  • Adversarial ML: jailbreak datasets, prompt injection, RLHF/DPO attacks, model extraction
  • Cybersecurity: penetration testing, exploit development, reverse engineering
  • Socio-technical risk: harassment/disinformation probing, abuse analysis, conversational AI testing
  • Creative probing: psychology, acting, or writing for unconventional adversarial thinking

Success Metrics

  • Uncover vulnerabilities that automated tests miss
  • Deliver reproducible artifacts that strengthen customer AI systems
  • Expand evaluation coverage with more scenarios tested and fewer production surprises
  • Build customer trust in AI safety through thorough adversarial probing

Why Join Mercor

  • Build frontier experience in human data-driven AI red teaming and safety
  • Play a direct role in making AI systems more robust, safe, and trustworthy
  • Work remotely with flexible full-time or part-time contract arrangements
  • Competitive compensation aligned with expertise, sensitivity of work, and project scope

This is contract work available as full-time or part-time. All work is remote and restricted to candidates located in the United States, Egypt, Saudi Arabia, or United Arab Emirates.

Benture is an independent job board and is not affiliated with or employed by Mercor.

Tips for Applying to Mercor Jobs from Benture

Increase your chances of success!
1
Four Simple Steps

Upload resumeAI interviewComplete formSubmit application

2
Perfect Your Resume

Upload your best, up-to-date resume in English. Mercor will extract details and fill out your profile automatically. Review and adjust as needed.

3
Complete = Win

SHOCKING FACT: Only ~20% of applicants complete their application! Take the 15-minute AI interview about your experience and you'll have MUCH HIGHER chances of getting hired!

AI Interview Tips: The interview focuses on your resume and work experience. Be ready to discuss specific projects and how you solved challenges.

Takes about 15 minutes | Dramatically improves your chances

Related Jobs

Benture logo
See All Jobs