NumerosityVLM Benchmark

What is NumerosityVLM?

Evaluates zero-shot numerosity perception in vision-language models on 10,800 synthetic images across six controlled conditions manipulating object size…

Released

2026-08-15

Evaluates

General AI, Multimodal

Openness

unknown

Importer

Claire Radar

Review status

ai-reviewed

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2608.15425

NumerosityVLM paper, code and dataset

• Paper https://arxiv.org/abs/2608.15425
• Code https://github.com/fuy3/NumerosityVLM-Benchmark
• Dataset https://huggingface.co/datasets/fuy3/NumerosityVLM

Which sources cite NumerosityVLM?

• NumerosityVLM

Related General AI, Multimodal benchmarks

• $\tau^\tau$-Bench: An Environment for End-To-End, Realistic Agent Construction
• 3DCodeBench
• 5-Dialects-BN
• A-Bench
• A-OKVQA
• A3S-Bench
• AARRI-Bench
• ActBench