Benchmark

OSWorld

Screen resolution, OS image and action space all change results. The Verified and 2.0 revisions are not comparable to the original.

Released
2024-04-11
Categories
computer_use
Openness
unknown
Source
model_reports
Reported scores
4

Reported scores

model_reports

ModelOrganizationReported valueReportedEvidence
Claude Opus 5Anthropic70.572026-07-24evidence
Kimi K3Moonshot AI58.32026-06-13evidence
Kimi K3Moonshot AI84.82026-06-13evidence
Qwen3.5-397B-A17BQwen62.22026-02-16evidence

Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.