Benture logo
Turing logo

GenAI Security Evaluation Engineer at Turing

posted 16 hours ago
turing.com Contractor remote Varies 58 views

GenAI Security Evaluation Engineer | Varies | Remote | Contractor

Turing is hiring security engineers to evaluate how effectively static analysis tools detect vulnerabilities in GenAI applications. You'll build small, runnable agent and RAG codebases containing realistic examples of Sensitive Information Disclosure and Excessive Agency, then trace, annotate, test, and explain each finding.

What You'll Do

  • Build runnable agent and RAG repositories with code-reachable Sensitive Information Disclosure or Excessive Agency vulnerabilities across tool calling, memory, and MCP.
  • Create vulnerable, fixed, and hard-negative variants with minimal security-relevant differences.
  • Trace and annotate assets, data and action paths, controls, root causes, severity, and residual risk.
  • Define authorization contexts and write deterministic tests validating vulnerable, fixed, and negative behavior.
  • Recommend security controls and participate in calibration and peer review.

Requirements

  • 3+ years in application or product security, or security-focused software engineering, including secure code review.
  • Experience with source-to-sink analysis, taint analysis, SAST, CodeQL, or Semgrep.
  • Hands-on experience building LLM agents or RAG systems using frameworks such as LangChain, LlamaIndex, OpenAI or Anthropic SDKs, or MCP.
  • Strong authorization knowledge, including actors, trust boundaries, tenants, OAuth, IAM, identity, permitted data and actions, purposes, recipients, and document-level access control.
  • Production coding experience in Python and/or TypeScript, with strong judgment distinguishing genuine Sensitive Information Disclosure and Excessive Agency findings from non-findings.
  • Experience with OWASP LLM security risks, MCP, threat modeling, or security evaluation is a plus.

Schedule and Engagement

  • Contractor engagement of up to 2 weeks.
  • At least 4 hours per day, minimum 20 hours per week, including 4 hours of overlap with Pacific Time.
  • Location: Remote.

Hiring Process

  • AI interview (~25 minutes)
  • Resume and overall application review
  • Offer
Model Evaluator – AI/ML · Turing
Turing · $25/task · remote in Asia/Africa/LATAM · 3d ago
$25/task remote in Asia/Africa/LATAM 3d ago
Image Editing QA Reviewer · Turing
Turing · Varies · remote · 3d ago
Varies remote 3d ago
Model Evaluator (Go) · Turing
Turing · $25/task · remote (eligible countries) · 3d ago
$25/task remote (eligible countries) 3d ago
C# AI Model Evaluator · Turing
Turing · $25/task · remote in Asia, Africa, LATAM · 3d ago
$25/task remote in Asia, Africa, LATAM 3d ago
AI Model Evaluator (Java) · Turing
Turing · $25/task · remote in Asia, Africa, LATAM · 3d ago
$25/task remote in Asia, Africa, LATAM 3d ago
Python Model Evaluator (AI Coding) · Turing
Turing · $25/task · remote in Asia/Africa/LATAM · 3d ago
$25/task remote in Asia/Africa/LATAM 3d ago
AI Model Evaluator (JavaScript) · Turing
Turing · $25/task · remote in Asia/Africa/LATAM · 3d ago
$25/task remote in Asia/Africa/LATAM 3d ago
Python Code Reviewer · Turing
Turing · $25/task · remote:IN/PK/NG/EG/GH/BD/TR/MX · 4d ago
$25/task remote:IN/PK/NG/EG/GH/BD/TR/MX 4d ago
Personal Account Rater (Google) · Turing
Turing · Varies · remote · 4d ago
Varies remote 4d ago
Model Evaluator (DevOps) · Turing
Turing · $25/task · remote: Asia/Africa/LATAM · 4d ago
$25/task remote: Asia/Africa/LATAM 4d ago
Mobile AI Rater (Samsung Android) · Turing
Turing · $15/hr · remote · 5d ago
$15/hr remote 5d ago
Nurse Practitioner / Physician Assistant · Turing
Turing · Varies · remote in India · 5d ago
Varies remote in India 5d ago
Benture logo
See All Jobs
Apply Back