Data Science & Quantitative Analysis Expert | $60–90/hr | Remote (US Only)
Join a leading AI lab's GenAI team as a ground-truth expert, designing and evaluating rigorous analytical benchmarks for frontier AI models. This is a full-time W-2 position (approx. 35 hrs/week) employed through Cincinnatus LLC, fully remote within the United States.
About the Role
A top-tier AI lab is building the next generation of agentic evaluation benchmarks and needs experienced data scientists and quantitative analysts to help define what rigorous analytical work looks like. You will design complex, multi-day analysis tasks — comparing anomaly-detection algorithms, calculating correlations, performing spot checks, and summarizing findings in reproducible notebooks — then evaluate how frontier AI models perform against your expert-level solutions.
Key Responsibilities
- Design Tasks: Create realistic data-analysis challenges covering data cleaning, method comparison, and result interpretation.
- Author Notebooks: Produce clear, reproducible reference analyses in Jupyter or Google Colab.
- Compare Methods: Build fair, well-documented comparisons between analytical approaches with actionable recommendations.
- Evaluate Models: Review AI-generated analyses and rigorously verify the accuracy of statistics and conclusions.
- Collaborate: Work closely with researchers and fellow experts to maintain consistency and quality across evaluations.
Core Qualifications
- MSc or PhD in statistics, data science, or a quantitative STEM field — or equivalent research-heavy analytical experience.
- 1+ years in a research, research-engineering, or intensive data-analysis role.
- Deep hands-on skills in data cleaning, statistical correlation, and hypothesis testing.
- Proficiency with Jupyter Notebooks or Google Colab.
- Working knowledge of Python (pandas, NumPy, or similar) and Git.
- Strong written communication skills for conveying analytical findings to decision-makers.
- Preferred: Prior experience in AI training, model evaluation, or benchmark authoring.
- High attention to detail, creative task design ability, and comfort working through ambiguous, open-ended problems independently.
Employment Details
This role is a structured, full-time W-2 position administered by Cincinnatus LLC, an enterprise staffing company that partners with leading technology firms. Cincinnatus serves as the employer of record, providing payroll, benefits, and compliance support while you integrate directly into the client's team and workflows.
Cincinnatus is an Equal Employment Opportunity employer and is committed to providing reasonable accommodations for qualified individuals with disabilities throughout the hiring process.