Benchmark
AndroidWorld Benchmark
What is AndroidWorld?
AndroidWorld evaluates an agent's ability to operate in real Android GUI environments, completing multi-step tasks by perceiving screen content and executing…
- Released
- 2024-05-23
- Modality
- multimodal
- Evaluates
- agents, vision
- Openness
- unknown
- Importer
- LLM Stats
- Reported scores
- 5
Source provenance
- Original evidence https://api.zeroeval.com/leaderboard/benchmarks/androidworld?top_n=500
AndroidWorld results and reported scores
LLM Stats
| Model | Organization | Reported value | Reported | Evidence |
|---|---|---|---|---|
| GLM-5V-Turbo | Z.ai | 0.757 | 2026-04-02 | evidence |
| Qwen3.6-27B | Qwen | 0.703 | 2026-04-21 | evidence |
| Qwen3.7-Plus | Qwen | 0.81 | 2026-05-31 | evidence |
| Qwen3.8 Max | Qwen | 0.853 | 2026-08-02 | evidence |
| Qwen3.8-27B | Qwen | 0.819 | 2026-08-14 | evidence |
Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.