Benchmark

SuperGPQA Benchmark

What is SuperGPQA?

285 graduate disciplines; breadth comes at the cost of per-field sample size. Benchmark Radar tracks 4 reported scores for SuperGPQA, cited by 3 source…

Released: 2025-02-20
Evaluates: knowledge
Openness: unknown
Importer: Model reports
Reported scores: 4

Source provenance

Original evidence https://arxiv.org/abs/2502.14739

SuperGPQA paper

Paper https://arxiv.org/abs/2502.14739

SuperGPQA results and reported scores

Model reports

Model	Organization	Reported value	Reported	Evidence
Qwen3.5-397B-A17B	Qwen	70.4	2026-02-16	evidence
Seed2.0 Lite	ByteDance	57.9	2026-02-14	evidence
Seed2.0 Mini	ByteDance	49.8	2026-02-14	evidence
Seed2.0 Pro	ByteDance	68.7	2026-02-14	evidence

Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.

Which sources cite SuperGPQA?

DeepSeek-V4-Pro DeepSeek, 2026-04-22
Qwen3.5-397B-A17B Qwen, 2026-02-16
Seed2.0 (Pro / Lite / Mini) ByteDance, 2026-02-14