CRAB-Bench

What is CRAB-Bench?

CRAB-Bench evaluates LLM agents on tasks generated via a constraint graph over multiple interdependent entities, using the RUSE user simulator with imperfect…

Released

2026-06-01

Evaluates

Agents, General AI, Language & Knowledge

Openness

unknown

Importer

Claire Radar

Review status

unreviewed

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2606.01815

CRAB-Bench paper

• Paper https://arxiv.org/abs/2606.01815

Which sources cite CRAB-Bench?

• CRAB-Bench

Related Agents, General AI, Language & Knowledge benchmarks

• $\tau^\tau$-Bench: An Environment for End-To-End, Realistic Agent Construction
• 3DCodeBench
• 5-Dialects-BN
• A Large-Scale Dataset and Benchmark
• A3S-Bench
• AARRI-Bench
• ABC-Bench
• ActBench