Benchmark

RealKIE-FCC

RealKIE-FCC is a key information extraction benchmark drawn from real enterprise documents (FCC filings), part of the RealKIE suite of five novel datasets…

Modality
multimodal
Categories
multimodal, document_understanding, vision
Openness
unknown
Source
llm_stats
Reported scores
3

Reported scores

llm_stats

ModelOrganizationReported valueReportedEvidence
Nova 2 LiteAmazon0.6212025-12-02evidence
Nova 2 OmniAmazon0.5982025-12-02evidence
Nova 2 ProAmazon0.672025-12-02evidence

Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.