NovelAPIBench

What is NovelAPIBench?

NovelAPIBench is a dynamic benchmark for evaluating LLM tool use with novel APIs, covering knowledge components and diagnostic failure categories.

Released

2026-06-02

Evaluates

Agents, Agents & Tool Use, Factuality, Software & AI Compute, Tool use

Openness

unknown

Importer

Claire Radar

Review status

unreviewed

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2606.03657

NovelAPIBench paper

• Paper https://arxiv.org/abs/2606.03657

Which sources cite NovelAPIBench?

• NovelAPIBench

Related Agents, Agents & Tool Use, Factuality, Software & AI Compute, Tool use benchmarks

• $\tau^\tau$-Bench: An Environment for End-To-End, Realistic Agent Construction
• A3S-Bench
• Active-SWE
• AdaPlanBench
• Adaptive Adversaries
• ADeptS-Bench
• AeroCopilotBench
• AFT-Bench