Benchmark Radar™
Star —

SWE-Lancer Benchmark

Explore score history ↗

Software engineering freelancer tasks from Upwork; real-world constraints and client communication are part of the task.

Released
2025-02-17
Evaluates
coding agent
Openness
unknown
Importer
Model reports

SWE-Lancer code

SWE-Lancer results and reported scores

Reported benchmark scores · Model reports

Reported scores: 2

ModelOrganizationReported valueReportedEvidence
Seed2.0 LiteByteDance47.12026-02-14evidence
Seed2.0 ProByteDance49.42026-02-14evidence

Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.

Which sources cite SWE-Lancer?

Related coding agent benchmarks