LibEvoBench
Explore score history ↗LibEvoBench is a multi-task benchmark for evaluating code generation models on API evolution across versions of Python libraries. It includes tasks spanning multiple library versions and introduces the Software Evolution Understanding Score (SEUS) to measure version-specific knowledge consistency.
- Released
- 2026-06-24
- Institutions
- Delft University of Technology
- Evaluates
- Code, Code & Software, Code generation, Factuality, Software & AI Compute
- Openness
- unknown
- Importer
- Claire Radar
- Review status
- unreviewed
LibEvoBench paper
No reported scores are on record for this benchmark yet.