Benchmark
VQAv2 Benchmark
What is VQAv2?
VQAv2 is a balanced Visual Question Answering dataset that addresses language bias by providing complementary images for each question, forcing models to rely…
- Released
- 2016-12-02
- Modality
- multimodal
- Evaluates
- multimodal, reasoning, image to text, vision
- Openness
- unknown
- Importer
- LLM Stats
- Reported scores
- 3
Source provenance
- Original evidence https://api.zeroeval.com/leaderboard/benchmarks/vqav2?top_n=500
VQAv2 results and reported scores
LLM Stats
| Model | Organization | Reported value | Reported | Evidence |
|---|---|---|---|---|
| Llama 3.2 90B Instruct | Meta | 0.781 | 2024-09-25 | evidence |
| Pixtral Large | Mistral | 0.809 | 2024-11-18 | evidence |
| Pixtral-12B | Mistral | 0.786 | 2024-09-17 | evidence |
Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.