ConfidenceBench
Explore score history ↗A calibration benchmark evaluating verbalized confidence estimates in frontier LLMs using Brier scores across 200 multiple-choice questions in four categories. Scores are elicited via prompting without logits, applicable to closed and open models.
- Released
- 2026-07-10
- Institutions
- ETH Zurich · New York University · University of Pennsylvania
- Evaluates
- General AI, Language & Knowledge, cs.AI
- Openness
- unknown
- Importer
- Claire Radar
- Review status
- unreviewed
ConfidenceBench paper
No reported scores are on record for this benchmark yet.