Benchmark

AutoLogi Benchmark

What is AutoLogi?

AutoLogi is an automated method for synthesizing open-ended logic puzzles to evaluate reasoning abilities of Large Language Models. The benchmark addresses…

Modality
text
Evaluates
reasoning
Openness
unknown
Importer
LLM Stats
Reported scores
2

Source provenance

AutoLogi results and reported scores

LLM Stats

ModelOrganizationReported valueReportedEvidence
Kimi K2 InstructMoonshot AI0.8952025-07-11evidence
Kimi K2-Instruct-0905Moonshot AI0.8952025-09-05evidence

Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.

Which sources cite AutoLogi?

Related reasoning benchmarks