Benchmark
BoolQ Benchmark
What is BoolQ?
BoolQ is a reading comprehension dataset for yes/no questions containing 15,942 naturally occurring examples. Each example consists of a question, passage, and…
- Released
- 2019-05-24
- Modality
- text
- Evaluates
- reasoning, language
- Openness
- unknown
- Importer
- LLM Stats
- Reported scores
- 10
Source provenance
- Original evidence https://api.zeroeval.com/leaderboard/benchmarks/boolq?top_n=500
BoolQ results and reported scores
LLM Stats
| Model | Organization | Reported value | Reported | Evidence |
|---|---|---|---|---|
| Gemma 2 27B | 0.848 | 2024-06-27 | evidence | |
| Gemma 2 9B | 0.842 | 2024-06-27 | evidence | |
| Gemma 3n E2B | 0.764 | 2025-06-26 | evidence | |
| Gemma 3n E2B Instructed LiteRT (Preview) | 0.764 | 2025-05-20 | evidence | |
| Gemma 3n E4B | 0.816 | 2025-06-26 | evidence | |
| Gemma 3n E4B Instructed LiteRT Preview | 0.816 | 2025-05-20 | evidence | |
| Hermes 3 70B | Nous Research | 0.8804 | 2024-08-15 | evidence |
| Phi 4 Mini | Microsoft | 0.812 | 2025-02-01 | evidence |
| Phi-3.5-mini-instruct | Microsoft | 0.78 | 2024-08-23 | evidence |
| Phi-3.5-MoE-instruct | Microsoft | 0.846 | 2024-08-23 | evidence |
Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.