OmniInteract Benchmark
Explore score history ↗OmniInteract is a streaming benchmark for real-time omnimodal LLMs evaluated through native online inference over audio-visual streams. It contains 250 videos with 1,430 temporally grounded response slots (1Q1A and 1QnA), with each slot including trigger, response window, and target answer. Metrics include IA-QTF1, Interruption Diagnostic Suite, and Nested Chain Completion Score.
- Released
- 2026-05-26
- Evaluates
- Mathematics & Formal Science, Multimodal, cs.CV
- Openness
- unknown
- Importer
- Claire Radar
- Review status
- unreviewed
OmniInteract paper and code
No reported scores are on record for this benchmark yet.