TurtleAI Benchmark

What is TurtleAI?

TurtleAI is a benchmark of 823 tasks for visual programming in Turtle Graphics, evaluating models on perceiving geometric patterns and synthesizing Python code.

Released

2026-06-02

Evaluates

Code generation, General AI, Multimodal

Openness

unknown

Importer

Claire Radar

Review status

unreviewed

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2606.03626

TurtleAI paper

• Paper https://arxiv.org/abs/2606.03626

Which sources cite TurtleAI?

• TurtleAI

Related Code generation, General AI, Multimodal benchmarks

• $\tau^\tau$-Bench: An Environment for End-To-End, Realistic Agent Construction
• 3DCodeBench
• 5-Dialects-BN
• A-Bench
• A-OKVQA
• A3S-Bench
• AARRI-Bench
• ActBench