Benchmark Radar™
Star —

Ishigaki-IDS-Bench

Explore score history ↗

A benchmark for generating Information Delivery Specification (IDS) XML from BIM information requirements, with 166 examples in English and Japanese. It evaluates LLMs on formal validity via IDSAuditTool and content fidelity via facet-level macro-F1 against gold IDS files.

Released
2026-05-21
Evaluates
General AI, Language & Knowledge, cs.CL
Openness
unknown
Importer
Claire Radar
Review status
unreviewed

Ishigaki-IDS-Bench paper

No reported scores are on record for this benchmark yet.

Which sources cite Ishigaki-IDS-Bench?

Related General AI, Language & Knowledge, cs.CL benchmarks