CodeAssay Benchmark

What is CodeAssay?

CodeAssay is a benchmark of 185 Python tasks across ten software-engineering categories with audited ground truth, public and hidden tests, and code-property…

Released

2026-08-04

Evaluates

Code, Code & Software, Code generation, Software & AI Compute

Openness

unknown

Importer

Claire Radar

Review status

unreviewed

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2608.03535

CodeAssay paper

• Paper https://arxiv.org/abs/2608.03535

Which sources cite CodeAssay?

• CodeAssay

Related Code, Code & Software, Code generation, Software & AI Compute benchmarks

• Active-SWE
• AFT-Bench
• Agent App Benchmark
• Agent Retrieval Bench
• Agent Systems Benchmark (ASB)
• Agentic Evaluation in 2D Mazes
• Agentic Security Benchmark
• AgentInfraBench