MapReason-OSM Benchmark
Explore score history ↗MapReason-OSM evaluates vision-language models on graph-verifiable mobility decisions from self-rendered OpenStreetMap panels. It covers 12 tasks in routing, facility location, and visual disambiguation, with structured outputs scored against hidden oracles for validity, legality, optimality, and constraint satisfaction, plus cross-zoom consistency.
- Released
- 2026-06-21
- Institutions
- University of Central Florida · University of South Florida
- Evaluates
- Logistics & Operations, Multimodal
- Openness
- unknown
- Importer
- Claire Radar
- Review status
- unreviewed
MapReason-OSM paper and code
No reported scores are on record for this benchmark yet.