Benchmark Radar™
Star —

CRAB-Bench

Explore score history ↗

CRAB-Bench evaluates LLM agents on tasks generated via a constraint graph over multiple interdependent entities, using the RUSE user simulator with imperfect behavior. Scoring is pass@1 against valid solutions.

Released
2026-06-01
Institutions
Carnegie Mellon University
Evaluates
Agents, General AI, Language & Knowledge
Openness
unknown
Importer
Claire Radar
Review status
unreviewed

CRAB-Bench paper

No reported scores are on record for this benchmark yet.

Which sources cite CRAB-Bench?

Related Agents, General AI, Language & Knowledge benchmarks