Benchmark
Terminal-Bench
Environment image, timeout and permitted commands change results independently of the model. Version and harness both matter: 2.0 and 2.1 are different…
- Released
- 2025-05-19
- Categories
- agent
- Openness
- unknown
- Source
- model_reports
- Reported scores
- 15
Reported scores
model_reports
| Model | Organization | Reported value | Reported | Evidence |
|---|---|---|---|---|
| Claude Opus 4 | Anthropic | 43.2 | 2025-05-22 | evidence |
| DeepSeek-V4-Flash | DeepSeek | 56.9 | 2026-06-25 | evidence |
| DeepSeek-V4-Pro | DeepSeek | 59.1 | 2026-04-22 | evidence |
| DeepSeek-V4-Pro | DeepSeek | 63.3 | 2026-04-22 | evidence |
| DeepSeek-V4-Pro | DeepSeek | 67.9 | 2026-04-22 | evidence |
| DeepSeek-V4-Pro-0813 | DeepSeek | 87.9 | 2026-08-13 | evidence |
| Gemini 3.1 Pro | 68.5 | 2026-02-19 | evidence | |
| GLM-5 | Z.ai | 56.2 | 2026-02-11 | evidence |
| GLM-5.1 | Z.ai | 63.5 | 2026-04-03 | evidence |
| GLM-5.2 | Z.ai | 81.0 | 2026-06-16 | evidence |
| GLM-5.3-Flash | Z.ai | 84.3 | 2026-08-27 | evidence |
| Grok 4.5 | xAI | 83.3 | 2026-07-08 | evidence |
| Hy4 preview | Tencent | 85.4 | 2026-08-28 | evidence |
| Kimi K3 | Moonshot AI | 88.3 | 2026-06-13 | evidence |
| Qwen3.5-397B-A17B | Qwen | 52.5 | 2026-02-16 | evidence |
Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.