Mathematics Expert at Turing
posted 2 hours agoMathematics Expert | Contractor | Remote
Turing is seeking Mathematics experts to design realistic, terminal-based scientific tasks for Terminal Bench Science. You will create tasks involving numerical analysis, optimization, statistics, mathematical modeling, probability, dynamical systems, and computational mathematics. The goal is to evaluate whether AI agents can formulate mathematical problems, implement reliable algorithms, work in a terminal environment, debug numerical workflows, and produce verifiable computational results.
What the Work Involves
- Design authentic, multi-step computational mathematics tasks.
- Translate mathematical and research workflows into self-contained terminal environments.
- Prepare datasets, equations, model definitions, constraints, initial conditions, and expected outputs.
- Implement expert solutions using Python, R, Julia, C/C++, Bash, or other relevant tools.
- Create tasks involving optimization, numerical integration, differential equations, matrix computation, statistical inference, stochastic modeling, or algorithm analysis.
- Define grading criteria based on numerical accuracy, convergence, complexity, feasibility, and mathematical correctness.
- Set tolerances, stopping criteria, stability requirements, and reproducibility controls.
- Develop automated tests that validate results across edge cases and alternative valid implementations.
- Debug issues involving floating-point precision, solver failures, conditioning, convergence, and performance.
- Document assumptions, mathematical formulations, expected outputs, and known limitations.
Requirements
- Ph.D., postdoctoral experience, or equivalent advanced technical experience in mathematics, statistics, or a closely related discipline.
- Strong programming skills in Python, R, Julia, C/C++, Bash, or another relevant language.
- Experience working in Linux or terminal-based environments.
- Experience with numerical methods, optimization, statistics, mathematical modeling, or scientific computation.
- Ability to independently implement, test, and validate computational algorithms.
- Strong understanding of numerical stability, error analysis, mathematical assumptions, and reproducibility.
Preferred
- Experience with NumPy, SciPy, SymPy, pandas, scikit-learn, JAX, PyTorch, CVXPY, or similar tools.
- Familiarity with optimization solvers, probabilistic programming, differential-equation libraries, or numerical linear algebra packages.
- Experience with Monte Carlo methods, stochastic processes, Bayesian inference, graph algorithms, or computational geometry.
- Familiarity with Docker, Conda, Git, CI systems, and automated testing.
- Experience developing mathematical programming challenges, benchmark tasks, or automated graders.
Bonus Points
- Experience evaluating AI coding or terminal agents.
- Research software engineering experience.
- Experience with HPC or performance-critical numerical code.
- Publications or open-source contributions in applied mathematics or computational science.
- Experience designing tests that distinguish mathematically valid solutions from approximate or numerically unstable ones.
Pay and Location
Pay is not specified in the source listing. The role is remote; the source does not state restrictions on where applicants can be based.