TruthfulQA Benchmark

What is TruthfulQA?

TruthfulQA is a benchmark to measure whether a language model is truthful in generating answers to questions. The benchmark comprises 817 questions that span…

Released

2022-05-08

Evaluates

知识, Knowledge, 大语言模型, LLM, 知识储备, 事实可靠性, Factual Reliability, 开源收录, Open-Source, 不支持, Unsupported

Openness

unknown

Importer

OpenCompass Hub

Reported scores

0

Source provenance

• Original evidence https://hub.opencompass.org.cn/dataset-detail/TruthfulQA

TruthfulQA paper, code and dataset

• Paper https://arxiv.org/pdf/2109.07958
• Code https://github.com/sylinrl/TruthfulQA
• Dataset https://huggingface.co/datasets/truthfulqa/truthful_qa

Which sources cite TruthfulQA?

• TruthfulQA

Related 知识, Knowledge, 大语言模型, LLM, 知识储备, 事实可靠性, Factual Reliability, 开源收录, Open-Source, 不支持, Unsupported benchmarks

• A-Bench
• A-OKVQA
• AbsPyramid
• ActionAtlas
• Ada-LEval
• AECBench
• AFQMC
• AgentBoard