SpecRead Benchmark

What is SpecRead?

SpecRead evaluates specification comprehension via 383 questions over 10 OpenTitan IP blocks: exact retrieval, cross-section reasoning, contradiction detection…

Released

2026-09-27

Evaluates

Chip Design & EDA, Language & Knowledge, cs.AI

Openness

unknown

Importer

Claire Radar

Review status

ai-reviewed

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2609.33699

SpecRead paper and code

• Paper https://arxiv.org/abs/2609.33699
• Code https://github.com/EDGAhab/specread

Which sources cite SpecRead?

• SpecRead

Related Chip Design & EDA, Language & Knowledge, cs.AI benchmarks

• 2d-fet-bench
• 5-Dialects-BN
• A Large-Scale Dataset and Benchmark
• AARRI-Bench
• ABACUS
• ABC-Bench
• ActiveSciBench
• AdaMem-Bench