Benchmark
Vending Bench
What is Vending Bench?
Reported in simulated dollars, not a percentage, and run over long horizons where a single early failure dominates the total.
- Released
- 2025-02-18
- Evaluates
- agent
- Openness
- unknown
- Importer
- Model reports
- Reported scores
- 2
Source provenance
- Original evidence https://andonlabs.com/evals/vending-bench-2
Vending Bench links
Vending Bench results and reported scores
Model reports
Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.