SWE-Factory Benchmark

What is SWE-Factory?

SWE-Factory is a benchmark for evaluating large language models on software issue fixing tasks. Benchmark Radar tracks SWE-Factory, cited by 1 source…

Released

2025-06-12

Evaluates

代码, Code, 智能体, Agent, 任务执行, Task Execution, 代码工程, 不支持, Unsupported

Openness

unknown

Importer

OpenCompass Hub

Reported scores

0

Source provenance

• Original evidence https://hub.opencompass.org.cn/dataset-detail/SWE-Factory

SWE-Factory paper and code

• Paper https://arxiv.org/abs/2310.06770
• Paper https://arxiv.org/abs/2403.17927
• Paper https://arxiv.org/abs/2404.05427
• Paper https://arxiv.org/abs/2505.04606
• Paper https://arxiv.org/abs/2506.10954
• Code https://github.com/DeepSoftwareAnalytics/swe-factory

Which sources cite SWE-Factory?

• SWE-Factory

Related 代码, Code, 智能体, Agent, 任务执行, Task Execution, 代码工程, 不支持, Unsupported benchmarks

• A-Bench
• A-OKVQA
• AbsPyramid
• ActionAtlas
• Ada-LEval
• AECBench
• AFQMC
• AgentBoard