Benchmark
DeepSWE
Mini-swe-agent harness, temperature=0.95, top_p=1.0, max_new_tokens=64k under 1M context.
- Released
- 2025-09-15
- Categories
- coding_agent
- Openness
- unknown
- Source
- model_reports
- Reported scores
- 2
Reported scores
model_reports
| Model | Organization | Reported value | Reported | Evidence |
|---|---|---|---|---|
| GLM-5.3-Flash | Z.ai | 63.4 | 2026-08-27 | evidence |
| Hy4 preview | Tencent | 64.3 | 2026-08-28 | evidence |
Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.