Benchmark

MultiChallenge Benchmark

What is MultiChallenge?

Multi-turn instruction retention, graded by an LLM judge. Benchmark Radar tracks 3 reported scores for MultiChallenge, cited by 1 source documents, with links…

Evaluates
reasoning
Openness
unknown
Catalog source
Model reports
Reported scores
3

MultiChallenge paper

MultiChallenge results and reported scores

Model reports

ModelOrganizationReported valueReportedEvidence
Seed2.0 LiteByteDance63.22026-02-14evidence
Seed2.0 MiniByteDance61.12026-02-14evidence
Seed2.0 ProByteDance68.32026-02-14evidence

Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.

Which sources cite MultiChallenge?

Related reasoning benchmarks