CMMLU Benchmark

What is CMMLU?

CMMLU is a comprehensive Chinese evaluation benchmark specifically designed to assess the knowledge and reasoning abilities of language models in the context…

Released

2023-06-15

Evaluates

学科, Examination, 大语言模型, LLM, 知识储备, Knowledge, 开源收录, Open-Source, 支持, Supported

Openness

unknown

Importer

OpenCompass Hub

Reported scores

0

Source provenance

• Original evidence https://hub.opencompass.org.cn/dataset-detail/CMMLU

CMMLU paper and code

• Paper https://arxiv.org/abs/2306.09212
• Code https://github.com/haonan-li/CMMLU

Which sources cite CMMLU?

• CMMLU

Related 学科, Examination, 大语言模型, LLM, 知识储备, Knowledge, 开源收录, Open-Source, 支持, Supported benchmarks

• A-OKVQA
• AbsPyramid
• Ada-LEval
• AECBench
• AFQMC
• AGIEval
• AIR-Bench
• AIRBench-2024