GenAI Security Evaluation Engineer at Turing
posted 1 hour agoGenAI Security Evaluation Engineer | Up to $150/hr | Short-term contract
Turing is seeking experienced security engineers to evaluate how effectively static analysis tools detect vulnerabilities in GenAI applications. You will build small, runnable agent and retrieval-augmented generation (RAG) codebases with realistic Sensitive Information Disclosure and Excessive Agency vulnerabilities, plus fixed and near-miss versions.
What you’ll do
- Build code-reachable vulnerable, fixed, and hard-negative LLM application variants.
- Work with agents, RAG pipelines, memory, tool-calling, and MCP integrations.
- Trace and annotate source-to-sink paths, documenting root causes, controls, and remediations.
- Define authorization contexts, trust boundaries, and access rules.
- Write deterministic tests to validate findings and explain the results.
- Participate in calibration and peer review.
Requirements
- At least 5 years of experience in application security, product security, or security-focused software engineering.
- Hands-on experience with secure code review and source-to-sink analysis.
- Experience with SAST, taint analysis, CodeQL, Semgrep, or similar tools.
- Experience building or securing LLM applications, agents, or RAG systems.
- Strong knowledge of authorization, OAuth, IAM, ACLs, and multi-tenant security.
- Production coding experience in Python and/or TypeScript.
- Ability to distinguish genuine vulnerabilities from non-findings, including experience creating code-reachable examples, fixed variants, and hard negatives.
Experience with OWASP LLM security risks, MCP, threat modeling, or security evaluation is a plus.
Pay and schedule
- Contractor engagement lasting up to 2 weeks.
- Pay up to $150 per hour, depending on internal evaluation and location.
- At least 4 hours per day and a minimum of 20 hours per week, with 4 hours of overlap with Pacific Time.
Location
The listing does not specify a work location or eligible applicant countries.
Evaluation process
- AI interview lasting approximately 25 minutes.
- Resume and overall application review.
- Offer.