HoloBench

What is HoloBench?

HoloBench is a benchmark designed to evaluate the ability of long-context language models (LCLMs) to perform holistic reasoning over extended text contexts.

Released

2024-10-15

Evaluates

推理, Reasoning, 长文本, Long-Context, 大语言模型, LLM, 逻辑推理, 长上下文, Long Context, 不支持, Unsupported

Openness

unknown

Importer

OpenCompass Hub

Reported scores

0

Source provenance

• Original evidence https://hub.opencompass.org.cn/dataset-detail/HoloBench

HoloBench paper, code and dataset

• Paper https://arxiv.org/abs/2410.11996
• Code https://github.com/megagonlabs/holobench
• Dataset https://huggingface.co/datasets/megagonlabs/holobench

Which sources cite HoloBench?

• HoloBench

Related 推理, Reasoning, 长文本, Long-Context, 大语言模型, LLM, 逻辑推理, 长上下文, Long Context, 不支持, Unsupported benchmarks

• A-Bench
• A-OKVQA
• AbsPyramid
• ActionAtlas
• ActiveFly-Bench
• Ada-LEval
• AdvancedMathBench
• AECBench