DeepSWE Benchmark
Explore score history ↗Evaluates coding agents on 113 original, long-horizon software engineering tasks across 91 open-source repositories in five languages. Tasks are written from scratch, with hand-written verifiers that check requested functionality and accept any correct implementation.
- Released
- 2026-05-18
- Evaluates
- Code & Software, Software & AI Compute, cs.SE
- Openness
- unknown
- Importer
- Claire Radar
- Review status
- source-reviewed
DeepSWE paper, code and dataset
No reported scores are on record for this benchmark yet.