Benchmark Radar™
Star —

OmniInteract Benchmark

Explore score history ↗

OmniInteract is a streaming benchmark for real-time omnimodal LLMs evaluated through native online inference over audio-visual streams. It contains 250 videos with 1,430 temporally grounded response slots (1Q1A and 1QnA), with each slot including trigger, response window, and target answer. Metrics include IA-QTF1, Interruption Diagnostic Suite, and Nested Chain Completion Score.

Released
2026-05-26
Evaluates
Mathematics & Formal Science, Multimodal, cs.CV
Openness
unknown
Importer
Claire Radar
Review status
unreviewed

OmniInteract paper and code

No reported scores are on record for this benchmark yet.

Which sources cite OmniInteract?

Related Mathematics & Formal Science, Multimodal, cs.CV benchmarks