Benchmark
MRCR 1M Benchmark
What is MRCR 1M?
MRCR 1M is a variant of the Multi-Round Coreference Resolution benchmark designed for testing extremely long context capabilities with approximately 1 million…
- Modality
- text
- Evaluates
- long context, reasoning, general
- Openness
- unknown
- Importer
- LLM Stats
- Reported scores
- 4
Source provenance
- Original evidence https://api.zeroeval.com/leaderboard/benchmarks/mrcr-1m?top_n=500
MRCR 1M results and reported scores
LLM Stats
| Model | Organization | Reported value | Reported | Evidence |
|---|---|---|---|---|
| DeepSeek-V4-Flash-0423 | DeepSeek | 0.769 | 2026-04-23 | evidence |
| DeepSeek-V4-Flash-Max | DeepSeek | 0.787 | 2026-04-23 | evidence |
| DeepSeek-V4-Pro-Max | DeepSeek | 0.835 | 2026-04-23 | evidence |
| Gemini 2.0 Flash-Lite | 0.58 | 2025-02-05 | evidence |
Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.