MirrorCraft Benchmark
Explore score history ↗MirrorCraft is a paired benchmark for evaluating LLM-based agents under hidden rule changes in Minecraft. Each Mirror world copies a Vanilla world with modified server-side rules, while terrain and objectives match. It includes five biomes, six rule suites, three objectives, and uses deterministic milestones and Rule Intervention Effect.
- Released
- 2026-07-31
- Evaluates
- General AI, Language & Knowledge, cs.AI
- Openness
- unknown
- Importer
- Claire Radar
- Review status
- unreviewed
MirrorCraft paper
No reported scores are on record for this benchmark yet.