Benchmark
FRAMES Benchmark
What is FRAMES?
Factuality, Retrieval, And reasoning MEasurement Set - a unified evaluation dataset of 824 challenging multi-hop questions for testing retrieval-augmented…
- Released
- 2024-09-19
- Modality
- text
- Evaluates
- reasoning, search
- Openness
- unknown
- Importer
- LLM Stats
- Reported scores
- 2
Source provenance
- Original evidence https://api.zeroeval.com/leaderboard/benchmarks/frames?top_n=500
FRAMES results and reported scores
LLM Stats
| Model | Organization | Reported value | Reported | Evidence |
|---|---|---|---|---|
| DeepSeek-V3 | DeepSeek | 0.733 | 2024-12-25 | evidence |
| Kimi K2-Thinking-0905 | Moonshot AI | 0.87 | 2025-09-05 | evidence |
Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.