Benchmark
CompBench
What is CompBench?
CompBench is designed to evaluate the comparative reasoning capability of multimodal large language models, including a collection of around 40K image pairs…
- Released
- 2024-07-23
- Modality
- multimodal
- Evaluates
- 多模态, Multimodal, 推理, Reasoning, NeurIPS 2024, 多模态模型, VLM, 逻辑推理, 不支持, Unsupported
- Openness
- unknown
- Importer
- OpenCompass Hub
- Reported scores
- 0
Source provenance
- Original evidence https://hub.opencompass.org.cn/dataset-detail/CompBench
CompBench paper and code
- Paper https://arxiv.org/abs/1307.0414
- Paper https://arxiv.org/abs/2407.16837
- Paper https://arxiv.org/pdf/1506.08959
- Paper https://arxiv.org/pdf/1612.00837
- Paper https://arxiv.org/pdf/2004.12276
- Paper https://arxiv.org/pdf/2306.10012
- Paper https://arxiv.org/pdf/2402.07116
- Code https://github.com/RaptorMai/CompBench
No reported scores are on record for this benchmark yet.