Benchmark

MuSR Benchmark

What is MuSR?

MuSR (Multistep Soft Reasoning) is a benchmark for evaluating language models on multistep soft reasoning tasks specified in natural language narratives…

Released
2023-10-24
Modality
text
Evaluates
reasoning
Openness
unknown
Importer
LLM Stats
Reported scores
2

Source provenance

MuSR results and reported scores

LLM Stats

ModelOrganizationReported valueReportedEvidence
Hermes 3 70BNous Research0.50672024-08-15evidence
Kimi K2 InstructMoonshot AI0.7642025-07-11evidence

Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.

Which sources cite MuSR?

Related reasoning benchmarks