ShoppingMMLU Benchmark

What is ShoppingMMLU?

Shopping MMLU is a diverse multi-task online shopping benchmark derived from real-world Amazon data. It consists of 57 tasks covering 4 major shopping skills…

Released

2024-10-28

Evaluates

其他, Other, NeurIPS 2024, 大语言模型, LLM, 知识储备, Knowledge, 不支持, Unsupported

Openness

unknown

Importer

OpenCompass Hub

Reported scores

0

Source provenance

• Original evidence https://hub.opencompass.org.cn/dataset-detail/ShoppingMMLU

ShoppingMMLU paper and code

• Paper https://arxiv.org/abs/2410.20745
• Code https://github.com/KL4805/ShoppingMMLU

Which sources cite ShoppingMMLU?

• ShoppingMMLU

Related 其他, Other, NeurIPS 2024, 大语言模型, LLM, 知识储备, Knowledge, 不支持, Unsupported benchmarks

• A-Bench
• A-OKVQA
• AbsPyramid
• ActionAtlas
• Ada-LEval
• AECBench
• AFQMC
• AgentBoard