SWE-Bench ProMax
Explore score history ↗A multilingual code refactoring benchmark with 170 instances drawn from real commits across seven programming languages. Evaluates AI agents on large-scale refactoring tasks averaging 11.4 modified files and 261.6 lines of code, using manually curated issue descriptions and test suites.
- Released
- 2026-08-10
- Institutions
- Shanghai Jiao Tong University · Peking University · University of Chinese Academy of Sciences
- Evaluates
- Code & Software, Code generation, Software & AI Compute, cs.CL
- Openness
- unknown
- Importer
- Claire Radar
- Review status
- unreviewed
SWE-Bench ProMax paper and dataset
No reported scores are on record for this benchmark yet.