PlaylistEval

What is PlaylistEval?

PlaylistEval evaluates video-language judges on 630 question-answer pairs derived from 100-hour playlists, testing retrieval and judgment across seven domains.

Released

2026-09-28

Evaluates

General AI, Multimodal, cs.CV

Openness

unknown

Importer

Claire Radar

Review status

ai-reviewed

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2609.34314

PlaylistEval paper

• Paper https://arxiv.org/abs/2609.34314
• Website https://playlisteval.github.io

Which sources cite PlaylistEval?

• PlaylistEval

Related General AI, Multimodal, cs.CV benchmarks

• $\tau^\tau$-Bench: An Environment for End-To-End, Realistic Agent Construction
• 2d-fet-bench
• 360CityArena
• 3DCodeBench
• 5-Dialects-BN
• A Real-World CAD Segmentation Benchmark
• A-Bench
• A-OKVQA