MLE Bench – Data Analyst at Turing

MLE Bench Data Analyst | Contractor | Remote (India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Brazil, Mexico)

Turing is seeking experienced Data Analysts to contribute to benchmark-driven evaluation projects focused on real-world machine learning systems. This is a hands-on analytical role working at the intersection of data analysis and ML evaluation — ideal for professionals who thrive on rigorous, insight-driven work with production-like datasets.

About Turing

Based in San Francisco, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing accelerates frontier research with high-quality data, advanced training pipelines, and top AI researchers — and helps enterprises transform AI from proof of concept into measurable business impact.

What You'll Do

• Analyze structured and unstructured datasets generated from ML training, inference, and evaluation pipelines.
• Define, compute, and validate metrics used to assess model performance and behavior.
• Investigate data distributions, model outputs, failure modes, and edge cases relevant to benchmark tasks.
• Write and execute Python and SQL code to analyze data, generate reports, and support evaluation workflows.
• Validate data quality, consistency, and correctness across datasets and experiments.
• Produce clear, well-documented analytical artifacts and reproducible analysis workflows.
• Collaborate with ML engineers and researchers to design challenging, real-world evaluation scenarios for MLE Bench.

Requirements

• 3+ years of experience as a Data Analyst or Analytics-focused Engineer.
• Strong proficiency in Python for data analysis.
• Solid experience with SQL and relational datasets.
• Demonstrated experience analyzing ML outputs and evaluation metrics.
• Strong foundation in statistics and analytical reasoning.
• Ability to work with large, complex datasets and extract reliable insights.
• Experience writing clean, readable, and well-documented analytical code.
• Excellent spoken and written English communication skills.

Engagement Details

• Type: Contractor assignment (no medical/paid leave)
• Duration: 3 months (adjustable based on engagement)
• Commitment: Minimum 4 hours/day, 20 hours/week with 4-hour PST overlap
• Locations: India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Brazil, Mexico

Evaluation Process

• Technical interview with a live coding challenge (60 minutes)

Why Turing?

• Fully remote, flexible work environment.
• Opportunity to work on cutting-edge AI projects alongside leading LLM companies.