Benchmark
SWE-Lancer Benchmark
What is SWE-Lancer?
Software engineering freelancer tasks from Upwork; real-world constraints and client communication are part of the task.
- Evaluates
- coding agent
- Openness
- unknown
- Catalog source
- Model reports
- Reported scores
- 2
SWE-Lancer code
SWE-Lancer results and reported scores
Model reports
| Model | Organization | Reported value | Reported | Evidence |
|---|---|---|---|---|
| Seed2.0 Lite | ByteDance | 47.1 | 2026-02-14 | evidence |
| Seed2.0 Pro | ByteDance | 49.4 | 2026-02-14 | evidence |
Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.
Which sources cite SWE-Lancer?
- Seed2.0 (Pro / Lite / Mini) ByteDance, 2026-02-14