Benchmark

Humanity's Last Exam (with tools, text-only) Benchmark

What is Humanity's Last Exam (with tools, text-only)?

Text-only Humanity's Last Exam variant evaluated with tool use enabled. Benchmark Radar tracks 3 reported scores for Humanity's Last Exam (with tools…

Released
2025-01-24
Modality
text
Evaluates
math, reasoning
Openness
unknown
Importer
LLM Stats
Reported scores
3

Source provenance

Humanity's Last Exam (with tools, text-only) results and reported scores

LLM Stats

ModelOrganizationReported valueReportedEvidence
DeepSeek-V4-Pro-0813DeepSeek0.62026-08-13evidence
Hy3Tencent0.5322026-07-06evidence
Qwen3.8 MaxQwen0.5622026-08-02evidence

Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.

Which sources cite Humanity's Last Exam (with tools, text-only)?

Related math, reasoning benchmarks