MMBench-Live
Explore score history ↗MMBench-Live is a continuously evolving multimodal benchmark built by a multi-agent pipeline from MMBench. It contains 5.9K newly generated evaluation instances with executable reasoning, and evaluates vision-language models across question-answer generation and reasoning tasks. Updates cost about USD 30 and take 1-2 hours, with distribution-consistent strategy to maintain comparability.
- Released
- 2026-07-02
- Evaluates
- Agents, General AI, Multimodal
- Openness
- unknown
- Importer
- Claire Radar
- Review status
- unreviewed
MMBench-Live paper and code
No reported scores are on record for this benchmark yet.