Benchmark Radar™
Star —

COLLIE Benchmark

Explore score history ↗

Systematic construction of constrained text generation tasks; evaluates rich, compositional constraints across diverse generation levels.

Released
2023-07-17
Evaluates
reasoning
Openness
unknown
Importer
Model reports

COLLIE links

COLLIE results and reported scores

Reported benchmark scores · Model reports

Reported scores: 3

ModelOrganizationReported valueReportedEvidence
Seed2.0 LiteByteDance94.02026-02-14evidence
Seed2.0 MiniByteDance91.22026-02-14evidence
Seed2.0 ProByteDance93.92026-02-14evidence

Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.

Which sources cite COLLIE?

Related reasoning benchmarks