Benchmark
AutomationBench
What is AutomationBench?
Published by Zapier over its own automation surface, and cards report different task subsets of it. Benchmark Radar tracks 6 reported scores for…
- Released
- 2026-03-10
- Evaluates
- agent
- Openness
- unknown
- Importer
- Model reports
- Reported scores
- 6
Source provenance
- Original evidence https://github.com/zapier/automation-bench
AutomationBench code
AutomationBench results and reported scores
Model reports
| Model | Organization | Reported value | Reported | Evidence |
|---|---|---|---|---|
| Claude Opus 5 | Anthropic | 26.0 | 2026-07-24 | evidence |
| DeepSeek-V4-Pro-0813 | DeepSeek | 31.8 | 2026-08-13 | evidence |
| DeepSeek-V4.1-Flash | DeepSeek | 54.8 | 2026-09-10 | evidence |
| GLM-5.3-Flash | Z.ai | 48.8 | 2026-08-27 | evidence |
| Hy4 preview | Tencent | 32.1 | 2026-08-28 | evidence |
| Kimi K3 | Moonshot AI | 30.8 | 2026-06-13 | evidence |
Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.
Which sources cite AutomationBench?
- DeepSeek-V4.1-Flash DeepSeek, 2026-09-10
- Hy4 preview Tencent, 2026-08-28
- GLM-5.3-Flash Z.ai, 2026-08-27
- DeepSeek-V4-Pro-0813 DeepSeek, 2026-08-13
- Claude Opus 5 Anthropic, 2026-07-24
- Kimi K3 Moonshot AI, 2026-06-13
- Claude Fable 5 and Mythos 5 Anthropic, 2026-06-09