PuMVR Benchmark

What is PuMVR?

A multilingual visual-reasoning benchmark comprising parallel Punjabi image-text instances in Gurmukhi, Shahmukhi, and Roman scripts.

Released

2026-06-15

Evaluates

General AI, Multimodal, Reasoning

Openness

unknown

Importer

Claire Radar

Review status

ai-reviewed

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2606.17188

PuMVR paper and code

• Paper https://arxiv.org/abs/2606.17188
• Code https://github.com/prabhjotschugh/Not-Truly-Multilingual-PuMVR

Which sources cite PuMVR?

• PuMVR

Related General AI, Multimodal, Reasoning benchmarks

• $\tau^\tau$-Bench: An Environment for End-To-End, Realistic Agent Construction
• 3DCodeBench
• 5-Dialects-BN
• A-Bench
• A-OKVQA
• A3S-Bench
• AARRI-Bench
• ActBench