SWE-NFI Benchmark

What is SWE-NFI?

A benchmark of 188 tasks for evaluating coding agents on non-functional improvements in Python projects, with 92 executable rules combining functional…

Released

2026-07-29

Evaluates

Code & Software, General AI, cs.SE

Openness

unknown

Importer

Claire Radar

Review status

unreviewed

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2607.27409

SWE-NFI paper

• Paper https://arxiv.org/abs/2607.27409

Which sources cite SWE-NFI?

• SWE-NFI

Related Code & Software, General AI, cs.SE benchmarks

• $\tau^\tau$-Bench: An Environment for End-To-End, Realistic Agent Construction
• 3DCodeBench
• 5-Dialects-BN
• A3S-Bench
• AARRI-Bench
• ActBench
• Active-SWE
• ActiveSciBench