Benture logo

Posted over 30 days ago. Roles like this often stay open for a while, so it's still worth applying.

Turing logo

Mathematics Expert at Turing

posted 1 month ago
turing.com Contractor remote Varies 348 views

Mathematics Expert | Contractor | Remote

Turing is seeking Mathematics experts to design realistic, terminal-based scientific tasks for Terminal Bench Science. You will create tasks involving numerical analysis, optimization, statistics, mathematical modeling, probability, dynamical systems, and computational mathematics. The goal is to evaluate whether AI agents can formulate mathematical problems, implement reliable algorithms, work in a terminal environment, debug numerical workflows, and produce verifiable computational results.

What the Work Involves

  • Design authentic, multi-step computational mathematics tasks.
  • Translate mathematical and research workflows into self-contained terminal environments.
  • Prepare datasets, equations, model definitions, constraints, initial conditions, and expected outputs.
  • Implement expert solutions using Python, R, Julia, C/C++, Bash, or other relevant tools.
  • Create tasks involving optimization, numerical integration, differential equations, matrix computation, statistical inference, stochastic modeling, or algorithm analysis.
  • Define grading criteria based on numerical accuracy, convergence, complexity, feasibility, and mathematical correctness.
  • Set tolerances, stopping criteria, stability requirements, and reproducibility controls.
  • Develop automated tests that validate results across edge cases and alternative valid implementations.
  • Debug issues involving floating-point precision, solver failures, conditioning, convergence, and performance.
  • Document assumptions, mathematical formulations, expected outputs, and known limitations.

Requirements

  • Ph.D., postdoctoral experience, or equivalent advanced technical experience in mathematics, statistics, or a closely related discipline.
  • Strong programming skills in Python, R, Julia, C/C++, Bash, or another relevant language.
  • Experience working in Linux or terminal-based environments.
  • Experience with numerical methods, optimization, statistics, mathematical modeling, or scientific computation.
  • Ability to independently implement, test, and validate computational algorithms.
  • Strong understanding of numerical stability, error analysis, mathematical assumptions, and reproducibility.

Preferred

  • Experience with NumPy, SciPy, SymPy, pandas, scikit-learn, JAX, PyTorch, CVXPY, or similar tools.
  • Familiarity with optimization solvers, probabilistic programming, differential-equation libraries, or numerical linear algebra packages.
  • Experience with Monte Carlo methods, stochastic processes, Bayesian inference, graph algorithms, or computational geometry.
  • Familiarity with Docker, Conda, Git, CI systems, and automated testing.
  • Experience developing mathematical programming challenges, benchmark tasks, or automated graders.

Bonus Points

  • Experience evaluating AI coding or terminal agents.
  • Research software engineering experience.
  • Experience with HPC or performance-critical numerical code.
  • Publications or open-source contributions in applied mathematics or computational science.
  • Experience designing tests that distinguish mathematically valid solutions from approximate or numerically unstable ones.

Pay and Location

Pay is not specified in the source listing. The role is remote; the source does not state restrictions on where applicants can be based.

GenAI Security Evaluation Engineer · Turing
Turing · Varies · remote · 17h ago
Varies remote 17h ago
Model Evaluator – AI/ML · Turing
Turing · $25/task · remote in Asia/Africa/LATAM · 3d ago
$25/task remote in Asia/Africa/LATAM 3d ago
Image Editing QA Reviewer · Turing
Turing · Varies · remote · 3d ago
Varies remote 3d ago
Model Evaluator (Go) · Turing
Turing · $25/task · remote (eligible countries) · 3d ago
$25/task remote (eligible countries) 3d ago
C# AI Model Evaluator · Turing
Turing · $25/task · remote in Asia, Africa, LATAM · 3d ago
$25/task remote in Asia, Africa, LATAM 3d ago
AI Model Evaluator (Java) · Turing
Turing · $25/task · remote in Asia, Africa, LATAM · 4d ago
$25/task remote in Asia, Africa, LATAM 4d ago
Python Model Evaluator (AI Coding) · Turing
Turing · $25/task · remote in Asia/Africa/LATAM · 4d ago
$25/task remote in Asia/Africa/LATAM 4d ago
AI Model Evaluator (JavaScript) · Turing
Turing · $25/task · remote in Asia/Africa/LATAM · 4d ago
$25/task remote in Asia/Africa/LATAM 4d ago
Python Code Reviewer · Turing
Turing · $25/task · remote:IN/PK/NG/EG/GH/BD/TR/MX · 4d ago
$25/task remote:IN/PK/NG/EG/GH/BD/TR/MX 4d ago
Personal Account Rater (Google) · Turing
Turing · Varies · remote · 4d ago
Varies remote 4d ago
Model Evaluator (DevOps) · Turing
Turing · $25/task · remote: Asia/Africa/LATAM · 4d ago
$25/task remote: Asia/Africa/LATAM 4d ago
Mobile AI Rater (Samsung Android) · Turing
Turing · $15/hr · remote · 5d ago
$15/hr remote 5d ago
Benture logo
See All Jobs
Apply Back