Benchmark

MRCR v2 Benchmark

What is MRCR v2?

MRCR v2 (Multi-Round Coreference Resolution version 2) is an enhanced version of the synthetic long-context reasoning task. It extends the original MRCR…

Modality
text
Evaluates
long context, reasoning, general
Openness
unknown
Importer
LLM Stats
Reported scores
3

Source provenance

MRCR v2 results and reported scores

LLM Stats

ModelOrganizationReported valueReportedEvidence
DiffusionGemma 26B-A4BGoogle0.322026-06-10evidence
Gemini 2.5 Flash-LiteGoogle0.1662025-06-17evidence
Qwen3.7-PlusQwen0.9172026-05-31evidence

Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.

Which sources cite MRCR v2?

Related long context, reasoning, general benchmarks