DS-1000 Benchmark

What is DS-1000?

DS-1000 is a code generation benchmark with a thousand data science questions spanning seven Python libraries that (1) reflects diverse, realistic, and…

Released

2022-11-18

Evaluates

代码, code, 大语言模型, LLM, 代码工程, 开源收录, Open-Source, 不支持, Unsupported

Openness

unknown

Importer

OpenCompass Hub

Reported scores

0

Source provenance

• Original evidence https://hub.opencompass.org.cn/dataset-detail/DS-1000

DS-1000 paper and code

• Paper https://arxiv.org/pdf/2211.11501.pdf
• Code https://github.com/xlang-ai/DS-1000

Which sources cite DS-1000?

• DS-1000

Related 代码, code, 大语言模型, LLM, 代码工程, 开源收录, Open-Source, 不支持, Unsupported benchmarks

• A-Bench
• A-OKVQA
• AbsPyramid
• ActionAtlas
• Ada-LEval
• AECBench
• AFQMC
• AgentBoard