Benchmark
Big Bench Audio
Big Bench Audio is an audio reasoning benchmark adapted from a subset of Big Bench Hard, with text questions converted to spoken audio. It evaluates the…
- Modality
- audio
- Categories
- reasoning, audio
- Openness
- unknown
- Source
- llm_stats
- Reported scores
- 1
Reported scores
llm_stats
| Model | Organization | Reported value | Reported | Evidence |
|---|---|---|---|---|
| Nova 2 Sonic | Amazon | 0.87 | 2025-12-02 | evidence |
Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.