PlanBench-XL
Explore score history ↗PlanBench-XL evaluates LLM tool-use agents on long-horizon planning in large-scale tool ecosystems. It includes 327 retail tasks across 1,665 tools, requiring iterative tool retrieval and use. Optional blocker mechanisms inject missing, failing, or distracting tools to test adaptive planning. Scoring is based on final answer accuracy and auxiliary metrics.
- Released
- 2026-06-21
- Evaluates
- Agents & Tool Use, General AI, Planning, cs.AI
- Openness
- unknown
- Importer
- Claire Radar
- Review status
- unreviewed
PlanBench-XL paper and code
No reported scores are on record for this benchmark yet.