Benchmark

Big Bench Audio

What is Big Bench Audio?

Big Bench Audio is an audio reasoning benchmark adapted from a subset of Big Bench Hard, with text questions converted to spoken audio. It evaluates the…

Modality
audio
Evaluates
reasoning, audio
Openness
unknown
Importer
LLM Stats
Reported scores
1

Source provenance

Big Bench Audio results and reported scores

LLM Stats

ModelOrganizationReported valueReportedEvidence
Nova 2 SonicAmazon0.872025-12-02evidence

Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.

Which sources cite Big Bench Audio?

Related reasoning, audio benchmarks