Benchmark

CRUX-O Benchmark

What is CRUX-O?

CRUXEval-O (output prediction) is part of the CRUXEval benchmark consisting of 800 Python functions (3-13 lines) designed to evaluate AI models' capabilities…

Released
2024-01-05
Modality
text
Evaluates
reasoning
Openness
unknown
Importer
LLM Stats
Reported scores
1

Source provenance

CRUX-O results and reported scores

LLM Stats

ModelOrganizationReported valueReportedEvidence
Qwen3 235B A22BQwen0.792025-04-29evidence

Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.

Which sources cite CRUX-O?

Related reasoning benchmarks