Benchmark

OmniBench

What is OmniBench?

A novel multimodal benchmark designed to evaluate large language models' ability to recognize, interpret, and reason across visual, acoustic, and textual…

Modality
multimodal
Evaluates
multimodal, reasoning, vision
Openness
unknown
Importer
LLM Stats
Reported scores
1

Source provenance

OmniBench results and reported scores

LLM Stats

ModelOrganizationReported valueReportedEvidence
Qwen2.5-Omni-7BQwen0.56132025-03-27evidence

Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.

Which sources cite OmniBench?

Related multimodal, reasoning, vision benchmarks