Benchmark
Aider Polyglot
Edit-format sensitive; whole-file and diff modes differ substantially.
- Released
- 2024-12-21
- Categories
- coding
- Openness
- unknown
- Source
- model_reports
- Reported scores
- 2
Reported scores
model_reports
| Model | Organization | Reported value | Reported | Evidence |
|---|---|---|---|---|
| DeepSeek-R1 | DeepSeek | 53.3 | 2025-01-22 | evidence |
| Gemini 2.5 Pro | 82.2 | 2025-06-17 | evidence |
Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.