SIMMER Benchmark

What is SIMMER?

SIMMER evaluates latent failures in LLM-generated plans for kitchen-domain tasks using a curated symbolic world model with 77 actions and 262 objects, scoring…

Released

2026-06-12

Evaluates

General AI, Language & Knowledge, Planning, cs.CL

Openness

unknown

Importer

Claire Radar

Review status

unreviewed

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2606.14574

SIMMER paper

• Paper https://arxiv.org/abs/2606.14574

Which sources cite SIMMER?

• SIMMER

Related General AI, Language & Knowledge, Planning, cs.CL benchmarks

• $\tau^\tau$-Bench: An Environment for End-To-End, Realistic Agent Construction
• 3DCodeBench
• 5-Dialects-BN
• A Large-Scale Dataset and Benchmark
• A3S-Bench
• AARRI-Bench
• ABC-Bench
• ActBench