MapReason-OSM Benchmark

What is MapReason-OSM?

MapReason-OSM evaluates vision-language models on graph-verifiable mobility decisions from self-rendered OpenStreetMap panels. It covers 12 tasks in routing…

Released

2026-06-21

Evaluates

Logistics & Operations, Multimodal

Openness

unknown

Importer

Claire Radar

Review status

unreviewed

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2606.22597

MapReason-OSM paper and code

• Paper https://arxiv.org/abs/2606.22597
• Code https://github.com/Vi-Sri/mapreason-osm

Which sources cite MapReason-OSM?

• MapReason-OSM

Related Logistics & Operations, Multimodal benchmarks

• 3DCodeBench
• A-Bench
• A-OKVQA
• ActionAtlas
• ActiveFly-Bench
• Agent Planning Benchmark
• AgentHazard
• Agentic Evaluation in 2D Mazes