Spec2Game Benchmark

What is Spec2Game?

Generating an executable program does not necessarily mean that it correctly implements the behavioral requirements specified in natural language.

Released

2026-10-03

Evaluates

General AI, Language & Knowledge, cs.AI

Openness

unknown

Importer

Claire Radar

Review status

rule-auto-admitted

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2610.04253

Spec2Game paper

• Paper https://arxiv.org/abs/2610.04253

Which sources cite Spec2Game?

• Spec2Game

Related General AI, Language & Knowledge, cs.AI benchmarks

• $\tau^\tau$-Bench: An Environment for End-To-End, Realistic Agent Construction
• 2d-fet-bench
• 3DCodeBench
• 5-Dialects-BN
• A Large-Scale Dataset and Benchmark
• A Real-World CAD Segmentation Benchmark
• A3S-Bench
• AARRI-Bench