Benchmark

MM-IQ Benchmark

What is MM-IQ?

MM-IQ is a comprehensive evaluation framework comprising 2,710 meticulously curated test items spanning 8 distinct reasoning paradigms.

Released: 2025-02-02
Modality: multimodal
Evaluates: 多模态, Multimodal, 理解, Understanding, 多模态模型, VLM, 图像理解, Image Understanding, 不支持, Unsupported
Openness: open
Importer: OpenCompass Hub
Reported scores: 0

Source provenance

Original evidence https://hub.opencompass.org.cn/dataset-detail/MM-IQ

MM-IQ paper, code and dataset

Paper https://arxiv.org/abs/2502.00698
Code https://github.com/AceCHQ/MMIQ
Dataset https://huggingface.co/datasets/huanqia/MM-IQ

No reported scores are on record for this benchmark yet.

Which sources cite MM-IQ?

MM-IQ

Related 多模态, Multimodal, 理解, Understanding, 多模态模型, VLM, 图像理解, Image Understanding, 不支持, Unsupported benchmarks