Benchmark
BIG-Bench Extra Hard
What is BIG-Bench Extra Hard?
Successor to BBH after saturation; per-task variance is high. Benchmark Radar tracks 1 reported scores for BIG-Bench Extra Hard, cited by 1 source documents…
- Released
- 2025-02-26
- Evaluates
- reasoning
- Openness
- unknown
- Importer
- Model reports
- Reported scores
- 1
Source provenance
- Original evidence https://arxiv.org/abs/2502.19187
BIG-Bench Extra Hard paper
BIG-Bench Extra Hard results and reported scores
Model reports
| Model | Organization | Reported value | Reported | Evidence |
|---|---|---|---|---|
| Gemma 4 (31B) | 74.4 | 2026-03-11 | evidence |
Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.
Which sources cite BIG-Bench Extra Hard?
- Gemma 4 (31B) Google, 2026-03-11