Benchmark
MM IF-Eval
What is MM IF-Eval?
A challenging multimodal instruction-following benchmark that includes both compose-level constraints for output responses and perception-level constraints…
- Modality
- multimodal
- Evaluates
- multimodal, reasoning, structured output
- Openness
- unknown
- Importer
- LLM Stats
- Reported scores
- 2
Source provenance
- Original evidence https://api.zeroeval.com/leaderboard/benchmarks/mm-if-eval?top_n=500
MM IF-Eval results and reported scores
LLM Stats
| Model | Organization | Reported value | Reported | Evidence |
|---|---|---|---|---|
| LFM2.5-VL-3B | Liquid AI | 0.606 | 2026-08-12 | evidence |
| Pixtral-12B | Mistral | 0.527 | 2024-09-17 | evidence |
Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.