Benchmark
ScienceQA Benchmark
What is ScienceQA?
ScienceQA is the first large-scale multimodal science question answering benchmark with 21,208 multiple-choice questions covering 3 subjects (natural science…
- Released
- 2022-09-20
- Modality
- multimodal
- Evaluates
- math, multimodal, reasoning, vision
- Openness
- unknown
- Importer
- LLM Stats
- Reported scores
- 1
Source provenance
- Original evidence https://api.zeroeval.com/leaderboard/benchmarks/scienceqa?top_n=500
ScienceQA results and reported scores
LLM Stats
| Model | Organization | Reported value | Reported | Evidence |
|---|---|---|---|---|
| Phi-3.5-vision-instruct | Microsoft | 0.913 | 2024-08-23 | evidence |
Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.