RE-Bench

What is RE-Bench?

RE-Bench (Research Engineering Benchmark, v1) consists of 7 challenging, open-ended ML research engineering environments and data from 71 8-hour attempts by 61…

Released

2024-11-22

Evaluates

强推理, Strong Reasoning, 代码, Code, 智能体, Agent, 任务执行, Task Execution, 逻辑推理, Reasoning, 代码工程, 不支持, Unsupported

Openness

unknown

Importer

OpenCompass Hub

Reported scores

0

Source provenance

• Original evidence https://hub.opencompass.org.cn/dataset-detail/RE-Bench

RE-Bench paper and code

• Paper https://arxiv.org/abs/2411.15114
• Code https://github.com/METR/ai-rd-tasks

Which sources cite RE-Bench?

• RE-Bench

Related 强推理, Strong Reasoning, 代码, Code, 智能体, Agent, 任务执行, Task Execution, 逻辑推理, Reasoning, 代码工程, 不支持, Unsupported benchmarks

• A-Bench
• A-OKVQA
• AbsPyramid
• ActionAtlas
• ActiveFly-Bench
• Ada-LEval
• AdvancedMathBench
• AECBench