Benchmark
MCPMark
Depends on live third-party MCP servers, so runs are not reproducible over time.
- Released
- 2025-09-30
- Categories
- tool_use
- Openness
- unknown
- Source
- model_reports
- Reported scores
- 2
Reported scores
model_reports
| Model | Organization | Reported value | Reported | Evidence |
|---|---|---|---|---|
| Kimi K3 | Moonshot AI | 94.5 | 2026-06-13 | evidence |
| Qwen3.5-397B-A17B | Qwen | 46.1 | 2026-02-16 | evidence |
Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.