Benchmark

BrokenArXiv

arXiv proofs with planted errors; tests whether a model catches a broken argument instead of reproducing it.

Categories
math
Openness
unknown
Source
model_reports
Reported scores
1

Reported scores

model_reports

ModelOrganizationReported valueReportedEvidence
Hy4 previewTencent54.62026-08-28evidence

Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.