Benchmark

MathVerse Benchmark

What is MathVerse?

MathVerse evaluates multimodal mathematical reasoning, testing whether models genuinely interpret visual math diagrams rather than relying on text.

Released
2024-03-21
Modality
multimodal
Evaluates
math, multimodal, reasoning, vision
Openness
unknown
Importer
LLM Stats
Reported scores
2

Source provenance

MathVerse results and reported scores

LLM Stats

ModelOrganizationReported valueReportedEvidence
Seed 2.1 ProByteDance0.8972026-06-24evidence
Seed 2.1 TurboByteDance0.8922026-06-24evidence

Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.

Which sources cite MathVerse?

Related math, multimodal, reasoning, vision benchmarks