Benchmark

MATH-500

Largely saturated at the frontier.

Released
2021-03-05
Categories
math
Openness
unknown
Source
model_reports
Reported scores
3

Reported scores

model_reports

ModelOrganizationReported valueReportedEvidence
DeepSeek-R1DeepSeek97.32025-01-22evidence
DeepSeek-V3DeepSeek90.22024-12-27evidence
Qwen3-235B-A22B (Thinking)Qwen98.02025-05-14evidence

Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.