MMStar Benchmark

What is MMStar?

MMStar is an elite vision-indispensable multi-modal benchmark comprising 1,500 samples meticulously selected by humans. MMStar benchmarks 6 core capabilities…

Released

2024-04-09

Evaluates

其他, Other, 多模态模型, VLM, 跨模态推理, Cross-modal Reasoning, 不支持, Unsupported

Openness

restricted

Importer

OpenCompass Hub

Reported scores

0

Source provenance

• Original evidence https://hub.opencompass.org.cn/dataset-detail/MMStar

MMStar paper, code and dataset

• Paper https://arxiv.org/pdf/2403.20330
• Code https://github.com/MMStar-Benchmark/MMStar
• Dataset https://huggingface.co/datasets/Lin-Chen/MMStar

Which sources cite MMStar?

• MMStar

Related 其他, Other, 多模态模型, VLM, 跨模态推理, Cross-modal Reasoning, 不支持, Unsupported benchmarks

• A-Bench
• A-OKVQA
• AbsPyramid
• ActionAtlas
• Ada-LEval
• AECBench
• AFQMC
• AgentBoard