Benchmark Radar™
Star —

SWE-Bench ProMax

Explore score history ↗

A multilingual code refactoring benchmark with 170 instances drawn from real commits across seven programming languages. Evaluates AI agents on large-scale refactoring tasks averaging 11.4 modified files and 261.6 lines of code, using manually curated issue descriptions and test suites.

Released
2026-08-10
Institutions
Shanghai Jiao Tong University · Peking University · University of Chinese Academy of Sciences
Evaluates
Code & Software, Code generation, Software & AI Compute, cs.CL
Openness
unknown
Importer
Claire Radar
Review status
unreviewed

SWE-Bench ProMax paper and dataset

No reported scores are on record for this benchmark yet.

Which sources cite SWE-Bench ProMax?

Related Code & Software, Code generation, Software & AI Compute, cs.CL benchmarks