WebMRE Benchmark

What is WebMRE?

Offline benchmark with 541 tasks and 5,293 steps derived from successful WebArena trajectories, with audited test labels and a deterministic protocol.

Released

2026-09-23

Evaluates

Agents & Tool Use, General AI, Multimodal

Openness

unknown

Importer

Claire Radar

Review status

ai-name-audit-deferred

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2609.27353

WebMRE paper

• Paper https://arxiv.org/abs/2609.27353

Which sources cite WebMRE?

• WebMRE

Related Agents & Tool Use, General AI, Multimodal benchmarks

• $\tau^\tau$-Bench: An Environment for End-To-End, Realistic Agent Construction
• 2d-fet-bench
• 3DCodeBench
• 5-Dialects-BN
• A Real-World CAD Segmentation Benchmark
• A-Bench
• A-OKVQA
• A3S-Bench