ERUnderstand Benchmark
Explore score history ↗ERUnderstand evaluates vision-language models on structured understanding of entity-relationship diagrams. The benchmark contains 2,960 diagrams across curated educational sources, real-world schemas, and synthetic data, with standardized machine-readable JSON annotations. Scoring uses F1, BLEU, and graph edit distance to measure how accurately models recover schema elements such as entities, relationships, attributes, and extended ER constructs.
- Released
- 2026-07-27
- Institutions
- Temple University
- Evaluates
- General AI, Multimodal
- Openness
- unknown
- Importer
- Claire Radar
- Review status
- unreviewed
ERUnderstand paper and code
No reported scores are on record for this benchmark yet.