Benture logo
Turing logo

Python Code Reviewer at Turing

posted 2 hours ago
turing.com Contractor remote:IN/PK/NG/EG/GH/BD/TR/MX $25/task 38 views

Python Code Reviewer (Tech Lead Level) | $25 per approved task | Remote

Turing, an AGI infrastructure company working with frontier AI labs, is hiring experienced software engineers to work hands-on with open-source Python repositories, including triaging GitHub issues, evaluating test coverage, and assessing how well LLMs fix bugs in real codebases.

What the work involves

  • Analyze and triage GitHub issues across trending open-source libraries.
  • Set up and configure code repositories, including Dockerization and environment setup.
  • Evaluate unit test coverage and quality.
  • Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
  • Collaborate with researchers to identify repositories and issues that are challenging for LLMs.

Requirements

  • Minimum 2+ years of overall software engineering experience, at tech lead level.
  • Strong experience with Python.
  • Proficiency with Git, Docker, and basic software pipeline setup.
  • Ability to understand and navigate complex codebases.
  • Comfortable running, modifying, and testing real-world projects locally.
  • Experience contributing to or evaluating open-source projects is a plus.

Nice to have

  • Previous participation in LLM research or evaluation projects.
  • Experience building or testing developer tools or automation agents.

Pay and schedule

  • Payment: $25 per approved task.
  • Commitment: minimum 40 hours per week, with 4 hours of overlap with PST.
  • Employment type: contractor assignment (no medical or paid leave).
  • Duration: 4-week contract, with an expected start date next week.

Eligible locations

Open to applicants based in India, Pakistan, Nigeria, Egypt, Ghana, Bangladesh, Turkey, or Mexico. The work is fully remote.

Selection process

An assessment-based review, taking approximately 75 minutes.

Model Evaluator (Go) · Turing
Turing · $25/task · remote (eligible countries) · 41m ago
$25/task remote (eligible countries) 41m ago
C# AI Model Evaluator · Turing
Turing · $25/task · remote in Asia, Africa, LATAM · 53m ago
$25/task remote in Asia, Africa, LATAM 53m ago
AI Model Evaluator (Java) · Turing
Turing · $25/task · remote in Asia, Africa, LATAM · 1h ago
$25/task remote in Asia, Africa, LATAM 1h ago
Python Model Evaluator (AI Coding) · Turing
Turing · $25/task · remote in Asia/Africa/LATAM · 1h ago
$25/task remote in Asia/Africa/LATAM 1h ago
AI Model Evaluator (JavaScript) · Turing
Turing · $25/task · remote in Asia/Africa/LATAM · 1h ago
$25/task remote in Asia/Africa/LATAM 1h ago
Personal Account Rater (Google) · Turing
Turing · Varies · remote · 5h ago
Varies remote 5h ago
Model Evaluator (DevOps) · Turing
Turing · $25/task · remote: Asia/Africa/LATAM · 5h ago
$25/task remote: Asia/Africa/LATAM 5h ago
Mobile AI Rater (Samsung Android) · Turing
Turing · $15/hr · remote · 1d ago
$15/hr remote 1d ago
Nurse Practitioner / Physician Assistant · Turing
Turing · Varies · remote in India · 1d ago
Varies remote in India 1d ago
Nurse Practitioner / Physician Assistant · Turing
Turing · Varies · remote in US · 1d ago
Varies remote in US 1d ago
Medical Doctor · Turing
Turing · Varies · remote in US · 1d ago
Varies remote in US 1d ago
SWE Bench Engineer - C++ · Turing
Turing · $25/task · remote:IN/PK/NG/EG/GH/BD/TR/MX · 2d ago
$25/task remote:IN/PK/NG/EG/GH/BD/TR/MX 2d ago
Benture logo
See All Jobs
Apply Back