LLM Red Team Specialist | $60–90/hr | Remote in US (Full Time)
Join a leading AI lab's GenAI team and play a critical role in shaping the next generation of agentic evaluation benchmarks. As an LLM Red Team Specialist, you will probe frontier AI models to uncover vulnerabilities, edge cases, and subtle failure modes — turning your findings into stronger, more rigorous benchmarks.
This is a full-time W-2 position (approx. 35 hrs/week) employed through Cincinnatus LLC, placed directly within a top-tier AI lab's extended workforce. Fully remote within the United States.
Key Responsibilities
- Probe Models: Explore how frontier AI systems behave on coding, ML, and analysis tasks — identifying where they quietly fail.
- Design Challenges: Convert discovered weaknesses into well-crafted, fair, and reproducible benchmark tasks.
- Document Findings: Produce clear, evidence-backed write-ups with reproducible steps.
- Strengthen Tasks: Collaborate with task authors to close loopholes, shortcuts, and grading gaps.
- Collaborate: Share insights with researchers and fellow specialists to continuously improve benchmark quality.
Qualifications
- MSc or PhD in a STEM field, or equivalent research-heavy practical experience involving data analysis and coding.
- 1+ years in a research, research-engineering, security, or AI evaluation role.
- Demonstrated ability to identify vulnerabilities or failure modes in LLMs or ML systems through red teaming, adversarial testing, or rigorous evaluation.
- Working proficiency in Python and Git; ability to script custom probes and analyses.
- Strong familiarity with LLM capabilities, limitations, and evaluation methodologies.
- Prior experience in AI training, model evaluation, or benchmark authoring is a plus.
- Detail-oriented, creative, and self-directed — comfortable navigating ambiguous, open-ended problems.
About the Employer
Cincinnatus LLC is an enterprise staffing company partnering with leading technology firms to place highly skilled professionals in structured, role-based engagements. Cincinnatus serves as the employer of record, providing W-2 employment, payroll, benefits, and compliance support.
Cincinnatus is an Equal Employment Opportunity employer and is committed to providing reasonable accommodations for qualified individuals with disabilities throughout the hiring process.
