CRAB-Bench
Explore score history ↗CRAB-Bench evaluates LLM agents on tasks generated via a constraint graph over multiple interdependent entities, using the RUSE user simulator with imperfect behavior. Scoring is pass@1 against valid solutions.
- Released
- 2026-06-01
- Institutions
- Carnegie Mellon University
- Evaluates
- Agents, General AI, Language & Knowledge
- Openness
- unknown
- Importer
- Claire Radar
- Review status
- unreviewed
CRAB-Bench paper
No reported scores are on record for this benchmark yet.