NL2Scratch Benchmark

What is NL2Scratch?

NL2Scratch is an executable benchmark for natural-language-to-Scratch generation, consisting of 311,648 parser-valid NL-program pairs extracted from real…

Released

2026-06-20

Evaluates

Code & Software, Code generation, General AI, cs.CL

Openness

unknown

Importer

Claire Radar

Review status

unreviewed

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2606.22061

NL2Scratch paper

• Paper https://arxiv.org/abs/2606.22061

Which sources cite NL2Scratch?

• NL2Scratch

Related Code & Software, Code generation, General AI, cs.CL benchmarks

• $\tau^\tau$-Bench: An Environment for End-To-End, Realistic Agent Construction
• 3DCodeBench
• 5-Dialects-BN
• A3S-Bench
• AARRI-Bench
• ActBench
• Active-SWE
• ActiveSciBench