Benchmark Radar™
Star —

ICAE-Bench

Explore score history ↗

ICAE-Bench evaluates coding agents on interactive project-building tasks. Agents receive a fuzzy product requirement and must clarify missing details via an automated user agent, then implement the project in a container. Scoring uses black-box tests and multi-dimensional diagnostics including functional correctness, semantic/API similarity, structural fidelity, design quality, and interaction quality.

Released
2026-07-23
Institutions
Fudan University · Meituan (China) · Singapore Management University
Evaluates
Agents & Tool Use, Software & AI Compute, cs.AI
Openness
unknown
Importer
Claire Radar
Review status
unreviewed

ICAE-Bench paper and code

No reported scores are on record for this benchmark yet.

Which sources cite ICAE-Bench?

Related Agents & Tool Use, Software & AI Compute, cs.AI benchmarks