Benchmark
BoolQ
BoolQ is a reading comprehension dataset for yes/no questions containing 15,942 naturally occurring examples. Each example consists of a question…
- Modality
- text
- Categories
- reasoning, language
- Openness
- unknown
- Source
- llm_stats
- Reported scores
- 10
Reported scores
llm_stats
| Model | Organization | Reported value | Reported | Evidence |
|---|---|---|---|---|
| Gemma 2 27B | 0.848 | 2024-06-27 | evidence | |
| Gemma 2 9B | 0.842 | 2024-06-27 | evidence | |
| Gemma 3n E2B | 0.764 | 2025-06-26 | evidence | |
| Gemma 3n E2B Instructed LiteRT (Preview) | 0.764 | 2025-05-20 | evidence | |
| Gemma 3n E4B | 0.816 | 2025-06-26 | evidence | |
| Gemma 3n E4B Instructed LiteRT Preview | 0.816 | 2025-05-20 | evidence | |
| Hermes 3 70B | Nous Research | 0.8804 | 2024-08-15 | evidence |
| Phi 4 Mini | Microsoft | 0.812 | 2025-02-01 | evidence |
| Phi-3.5-mini-instruct | Microsoft | 0.78 | 2024-08-23 | evidence |
| Phi-3.5-MoE-instruct | Microsoft | 0.846 | 2024-08-23 | evidence |
Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.