Benchmark

FlenQA Benchmark

What is FlenQA?

Flexible Length Question Answering dataset for evaluating the impact of input length on reasoning performance of language models, featuring True/False…

Modality
text
Evaluates
long context, reasoning
Openness
unknown
Importer
LLM Stats
Reported scores
2

Source provenance

FlenQA results and reported scores

LLM Stats

ModelOrganizationReported valueReportedEvidence
Phi 4 ReasoningMicrosoft0.9772025-04-30evidence
Phi 4 Reasoning PlusMicrosoft0.9792025-04-30evidence

Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.

Which sources cite FlenQA?

Related long context, reasoning benchmarks