ExtractBench
Explore score history ↗ExtractBench evaluates schema-guided extraction from enterprise documents. Given a document and a user-defined JSON schema, systems must return schema-valid JSON with correct values, include every record of repeated structures, mark missing fields as null, and provide source evidence. The benchmark includes 4,869 pages across 370 documents, 8 business domains, and 67 document types, with tags for challenge, perception, table structure, length, and domain. Scoring uses unified value F1 for value accuracy and word- and page-level F1 for grounding.
- Released
- 2026-07-31
- Evaluates
- Factuality, General AI, Language & Knowledge, cs.AI
- Openness
- unknown
- Importer
- Claire Radar
- Review status
- unreviewed
ExtractBench paper, code and dataset
No reported scores are on record for this benchmark yet.