Benchmark
COLLIE Benchmark
What is COLLIE?
Systematic construction of constrained text generation tasks; evaluates rich, compositional constraints across diverse generation levels.
- Evaluates
- reasoning
- Openness
- unknown
- Catalog source
- Model reports
- Reported scores
- 3
COLLIE links
COLLIE results and reported scores
Model reports
| Model | Organization | Reported value | Reported | Evidence |
|---|---|---|---|---|
| Seed2.0 Lite | ByteDance | 94.0 | 2026-02-14 | evidence |
| Seed2.0 Mini | ByteDance | 91.2 | 2026-02-14 | evidence |
| Seed2.0 Pro | ByteDance | 93.9 | 2026-02-14 | evidence |
Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.
Which sources cite COLLIE?
- Seed2.0 (Pro / Lite / Mini) ByteDance, 2026-02-14