SoundnessBench

What is SoundnessBench?

SoundnessBench evaluates LLMs' ability to judge the methodological soundness of research proposals. It contains 1,099 machine-learning research proposals…

Released

2026-05-28

Evaluates

AI Scientist, General AI, Language & Knowledge

Openness

unknown

Importer

Claire Radar

Review status

unreviewed

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2605.30329

SoundnessBench paper and code

• Paper https://arxiv.org/abs/2605.30329
• Code https://github.com/hosytuyen/SoundnessBench
• Website https://hosytuyen.github.io/projects/SoundnessBench

Which sources cite SoundnessBench?

• SoundnessBench

Related AI Scientist, General AI, Language & Knowledge benchmarks

• $\tau^\tau$-Bench: An Environment for End-To-End, Realistic Agent Construction
• 3DCodeBench
• 5-Dialects-BN
• A Large-Scale Dataset and Benchmark
• A3S-Bench
• AARRI-Bench
• ABC-Bench
• ActBench