ICAE-Bench
Explore score history ↗ICAE-Bench evaluates coding agents on interactive project-building tasks. Agents receive a fuzzy product requirement and must clarify missing details via an automated user agent, then implement the project in a container. Scoring uses black-box tests and multi-dimensional diagnostics including functional correctness, semantic/API similarity, structural fidelity, design quality, and interaction quality.
- Released
- 2026-07-23
- Institutions
- Fudan University · Meituan (China) · Singapore Management University
- Evaluates
- Agents & Tool Use, Software & AI Compute, cs.AI
- Openness
- unknown
- Importer
- Claire Radar
- Review status
- unreviewed
ICAE-Bench paper and code
No reported scores are on record for this benchmark yet.