SyntaxBench

What is SyntaxBench?

Large language models are increasingly used where small syntactic errors matter, yet character-level reasoning is still evaluated mostly through isolated…

Released

2026-10-02

Evaluates

General AI, Language & Knowledge, Reasoning

Openness

unknown

Importer

Claire Radar

Review status

rule-auto-admitted

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2610.03329

SyntaxBench paper

• Paper https://arxiv.org/abs/2610.03329

Which sources cite SyntaxBench?

• SyntaxBench

Related General AI, Language & Knowledge, Reasoning benchmarks

• $\tau^\tau$-Bench: An Environment for End-To-End, Realistic Agent Construction
• 2d-fet-bench
• 3DCodeBench
• 5-Dialects-BN
• A Large-Scale Dataset and Benchmark
• A Real-World CAD Segmentation Benchmark
• A-OKVQA
• A3S-Bench