Benture logo
 ←  next job →
Turing logo

Software Engineer – AI Research & Eval at Turing

posted 1 hour ago
turing.com Contractor remote in US Varies 40 views

Software Engineer – AI Research & Evaluation | Contractor | Remote (US-based) | 10–40 hrs/week

Turing is seeking experienced Software Engineers to join its AI Research & Evaluation team, helping shape the next generation of large language models by curating high-quality training data, evaluating AI-generated code, and building verification systems for frontier AI labs and global enterprises.

About Turing

Based in San Francisco, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for enterprises deploying advanced AI systems. Turing accelerates frontier research through high-quality data, advanced training pipelines, and top-tier AI researchers — and helps enterprises transform AI from proof of concept into measurable business impact.

Role Overview

As a Software Engineering Evaluator, you will create cutting-edge datasets used to train, benchmark, and advance large language models. You'll collaborate closely with researchers to curate code examples, provide precise solutions, and evaluate AI-generated code across multiple languages and domains — with a strong emphasis on systems-level programming, performance-critical applications, and infrastructure.

What You'll Do

  • Curate code examples, build solutions, and correct code in Python, C/C++, Rust, Go, Java, and JavaScript (including ReactJS) for AI model training initiatives.
  • Evaluate and refine AI-generated code for systems-level correctness, performance, scalability, and reliability.
  • Collaborate with cross-functional teams to benchmark and enhance AI-driven coding solutions.
  • Build agents capable of verifying the quality of systems-level and infrastructure code and identifying error patterns.
  • Analyze and evaluate model capabilities across the full software engineering lifecycle — from prototyping and architecture design to production, launch, monitoring, and maintenance.
  • Design automated verification mechanisms to validate solutions to complex software engineering tasks.

Required Skills

  • 3+ years of professional software engineering experience.
  • Strong expertise in systems programming, infrastructure, or backend development using Python, C/C++, Rust, and/or Go.
  • Proven experience building and deploying scalable, production-grade software.
  • Deep understanding of software architecture, design patterns, debugging, and code quality assessment.
  • Excellent written and verbal communication skills for producing clear, structured evaluation rationales.

Ideal Background

This role is a great fit for engineers who have shipped high-impact products at fast-moving companies such as Stripe, Airbnb, Cloudflare, Datadog, or Coinbase. Graduates from top CS programs (Stanford, MIT, CMU, UC Berkeley, Georgia Tech, etc.) are encouraged to apply — though exceptional experience always takes precedence over pedigree.

Engagement Details

  • Type: Contractor (no medical/paid leave benefits)
  • Commitment: Flexible — minimum 10 hrs/week, up to 40 hrs/week
  • Duration: 1 month, with potential extensions based on performance
  • Location: Must be based in the United States

Application Process

The application takes approximately 15–30 minutes and includes completion of an AI video interview.

Go back

Related Jobs

Benture logo
See All Jobs