Benchmark
AI2 Reasoning Challenge (ARC) Benchmark
What is AI2 Reasoning Challenge (ARC)?
A dataset of 7,787 genuine grade-school level, multiple-choice science questions assembled to encourage research in advanced question-answering. The dataset is…
- Released
- 2018-03-14
- Modality
- text
- Evaluates
- reasoning, general
- Openness
- unknown
- Importer
- LLM Stats
- Reported scores
- 1
Source provenance
AI2 Reasoning Challenge (ARC) results and reported scores
LLM Stats
| Model | Organization | Reported value | Reported | Evidence |
|---|---|---|---|---|
| GPT-4 | OpenAI | 0.963 | 2023-06-13 | evidence |
Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.