Benchmark
MME Benchmark
What is MME?
A comprehensive evaluation benchmark for Multimodal Large Language Models measuring both perception and cognition abilities across 14 subtasks. Features…
- Released
- 2023-06-23
- Modality
- multimodal
- Evaluates
- multimodal, reasoning, vision
- Openness
- unknown
- Importer
- LLM Stats
- Reported scores
- 4
Source provenance
- Original evidence https://api.zeroeval.com/leaderboard/benchmarks/mme?top_n=500
MME results and reported scores
LLM Stats
| Model | Organization | Reported value | Reported | Evidence |
|---|---|---|---|---|
| DeepSeek VL2 | DeepSeek | 0.2253 | 2024-12-13 | evidence |
| DeepSeek VL2 Small | DeepSeek | 0.2123 | 2024-12-13 | evidence |
| DeepSeek VL2 Tiny | DeepSeek | 0.1915 | 2024-12-13 | evidence |
| LFM2.5-VL-3B | Liquid AI | 0.731 | 2026-08-12 | evidence |
Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.