Can agents reason like scientists?

We work closely with human scientists to understand how to measure AI performance on real scientific tasks, and study what may generalize between fields and projects.

Our work

matplotgymNew

Can an agent make the right figure to substantiate a claim?

  1. Claim
  2. Pick data
  3. Encode
  4. Figure
  5. Supports the claim?

171 tasks · 59 papers · measured Oct 2026

Top models · mean score
GPT-6 Astra57.8
Claude Sonnet 556.2
GPT-5.554.4
papergymUpon request

Can an agent discover what a human scientist did?

  1. Question
  2. Hypothesis
  3. Method
  4. Result
  5. Scientifically sound?