LatchBio scBench
Explore score history ↗195 single-cell RNA-seq analysis evaluations, but the full set is withheld to prevent training contamination and only six canonical examples are public, so scores cannot be independently reproduced. The published 95% intervals span about ±5 to 6.5 points, and the harness matters (GPT-5.5 scores 57.95 in mini-swe-agent and 57.78 in OpenAI Codex). The arXiv paper (2602.09063) reports an earlier task set, so its numbers are not comparable with these.
- Evaluates
- biology
- Openness
- unknown
- Importer
- Model reports
LatchBio scBench code
LatchBio scBench results and reported scores
Reported benchmark scores · Model reports
Reported scores: 19
| Model | Organization | Reported value | Reported | Evidence |
|---|---|---|---|---|
| Claude Opus 4.5 | Anthropic | 47.18 | 2026-11-16 | evidence |
| Claude Opus 4.6 | Anthropic | 52.65 | 2026-11-16 | evidence |
| Claude Opus 4.7 | Anthropic | 54.02 | 2026-11-16 | evidence |
| Claude Opus 4.7 | Anthropic | 55.21 | 2026-11-16 | evidence |
| Claude Opus 4.8 | Anthropic | 57.95 | 2026-11-16 | evidence |
| Claude Opus 4.8 | Anthropic | 57.44 | 2026-11-16 | evidence |
| Claude Sonnet 4.5 | Anthropic | 33.16 | 2026-11-16 | evidence |
| Claude Sonnet 4.6 | Anthropic | 50.26 | 2026-11-16 | evidence |
| Gemini 2.5 Pro | 23.59 | 2026-11-16 | evidence | |
| Gemini 3.1 Pro Preview | 53.85 | 2026-11-16 | evidence | |
| Gemini 3.5 Flash | 56.92 | 2026-11-16 | evidence | |
| GPT-5.1 | OpenAI | 38.8 | 2026-11-16 | evidence |
| GPT-5.2 | OpenAI | 52.31 | 2026-11-16 | evidence |
| GPT-5.4 | OpenAI | 57.44 | 2026-11-16 | evidence |
| GPT-5.5 | OpenAI | 57.78 | 2026-11-16 | evidence |
| GPT-5.5 | OpenAI | 57.95 | 2026-11-16 | evidence |
| Grok 4.1 Fast (reasoning) | xAI | 30.26 | 2026-11-16 | evidence |
| Grok 4.20 Beta 0309 (reasoning) | xAI | 44.44 | 2026-11-16 | evidence |
| Grok 4.3 | xAI | 44.27 | 2026-11-16 | evidence |
Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.
Which sources cite LatchBio scBench?
- scBench results table (latchbio/scbench, commit 106726f) LatchBio, 2026-11-16