Benchmark
SciCode
Coding
- Categories
- intelligence-index, coding
- Openness
- unknown
- Source
- artificial_analysis
- Reported scores
- 577
Reported scores
artificial_analysis
| Model | Organization | Reported value | Reported | Evidence |
|---|---|---|---|---|
| A.X-K2 | SK Telecom | 0.385416666666667 | 2026-08-12 | evidence |
| Agnes 2.5 Pro Alpha | Sapiens AI | 0.422453703703704 | 2026-07-24 | evidence |
| Apertus 70B Instruct | Swiss AI Initiative | 0.056712962962963 | 2025-09-02 | evidence |
| Apertus 8B Instruct | Swiss AI Initiative | 0.0405092592592593 | 2025-09-02 | evidence |
| Apriel-v1.5-15B-Thinker | ServiceNow | 0.34837962962963 | 2025-09-30 | evidence |
| Apriel-v1.6-15B-Thinker | ServiceNow | 0.372685185185185 | 2025-11-25 | evidence |
| Celeris-1 | Celeris | 0.207175925925926 | 2026-07-24 | evidence |
| Claude 2.0 | Anthropic | 0.194444444444444 | 2023-07-11 | evidence |
| Claude 2.1 | Anthropic | 0.184027777777778 | 2023-11-21 | evidence |
| Claude 3 Haiku | Anthropic | 0.186342592592593 | 2024-03-04 | evidence |
| Claude 3 Opus | Anthropic | 0.232638888888889 | 2024-03-04 | evidence |
| Claude 3 Sonnet | Anthropic | 0.229166666666667 | 2024-03-04 | evidence |
| Claude 3.5 Haiku | Anthropic | 0.274305555555556 | 2024-10-22 | evidence |
| Claude 3.5 Sonnet (June '24) | Anthropic | 0.315972222222222 | 2024-06-21 | evidence |
| Claude 3.5 Sonnet (Oct '24) | Anthropic | 0.365740740740741 | 2024-10-22 | evidence |
| Claude 3.7 Sonnet (Non-reasoning) | Anthropic | 0.376157407407407 | 2025-02-24 | evidence |
| Claude 3.7 Sonnet (Reasoning) | Anthropic | 0.402777777777778 | 2025-02-24 | evidence |
| Claude 4 Opus (Non-reasoning) | Anthropic | 0.408564814814815 | 2025-05-22 | evidence |
| Claude 4 Opus (Reasoning) | Anthropic | 0.398148148148148 | 2025-05-22 | evidence |
| Claude 4 Sonnet (Non-reasoning) | Anthropic | 0.372685185185185 | 2025-05-22 | evidence |
| Claude 4 Sonnet (Reasoning) | Anthropic | 0.400462962962963 | 2025-05-22 | evidence |
| Claude 4.1 Opus (Reasoning) | Anthropic | 0.4089793103 | 2025-08-05 | evidence |
| Claude 4.5 Haiku (Non-reasoning) | Anthropic | 0.34375 | 2025-10-15 | evidence |
| Claude 4.5 Haiku (Reasoning) | Anthropic | 0.43287037037037 | 2025-10-15 | evidence |
| Claude 4.5 Sonnet (Non-reasoning) | Anthropic | 0.428240740740741 | 2025-09-29 | evidence |
| Claude 4.5 Sonnet (Reasoning) | Anthropic | 0.446759259259259 | 2025-09-29 | evidence |
| Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback) | Anthropic | 0.601851851851852 | 2026-06-09 | evidence |
| Claude Opus 4.5 (Non-reasoning) | Anthropic | 0.469907407407407 | 2025-11-24 | evidence |
| Claude Opus 4.5 (Reasoning) | Anthropic | 0.49537037037037 | 2025-11-24 | evidence |
| Claude Opus 4.6 (Adaptive Reasoning, Max Effort) | Anthropic | 0.518518518518518 | 2026-02-05 | evidence |
| Claude Opus 4.6 (Non-reasoning, High Effort) | Anthropic | 0.457175925925926 | 2026-02-05 | evidence |
| Claude Opus 4.7 (Adaptive Reasoning, Max Effort) | Anthropic | 0.545138888888889 | 2026-04-16 | evidence |
| Claude Opus 4.7 (Non-reasoning, High Effort) | Anthropic | 0.501157407407407 | 2026-04-16 | evidence |
| Claude Opus 4.8 (Adaptive Reasoning, Max Effort) | Anthropic | 0.534722222222222 | 2026-05-28 | evidence |
| Claude Opus 5 (Adaptive Reasoning, High Effort) | Anthropic | 0.542824074074074 | 2026-07-24 | evidence |
| Claude Opus 5 (Adaptive Reasoning, Low Effort) | Anthropic | 0.480324074074074 | 2026-07-24 | evidence |
| Claude Opus 5 (Adaptive Reasoning, Max Effort) | Anthropic | 0.556712962962963 | 2026-07-24 | evidence |
| Claude Opus 5 (Adaptive Reasoning, Medium Effort) | Anthropic | 0.506944444444444 | 2026-07-24 | evidence |
| Claude Opus 5 (Adaptive Reasoning, Xhigh Effort) | Anthropic | 0.549768518518518 | 2026-07-24 | evidence |
| Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort) | Anthropic | 0.467592592592593 | 2026-02-17 | evidence |
| Claude Sonnet 4.6 (Non-reasoning, High Effort) | Anthropic | 0.46875 | 2026-02-17 | evidence |
| Claude Sonnet 4.6 (Non-reasoning, Low Effort) | Anthropic | 0.440972222222222 | 2026-02-17 | evidence |
| Claude Sonnet 5 (Adaptive Reasoning, Max Effort) | Anthropic | 0.53587962962963 | 2026-06-30 | evidence |
| Claude Sonnet 5 (Non-reasoning, High Effort) | Anthropic | 0.486111111111111 | 2026-06-30 | evidence |
| Cogito v2.1 (Reasoning) | Deep Cogito | 0.409722222222222 | 2025-11-18 | evidence |
| Command A | Cohere | 0.28125 | 2025-03-13 | evidence |
| Command A+ | Cohere | 0.378472222222222 | 2026-05-20 | evidence |
| Command-R (Mar '24) | Cohere | 0.0625 | 2024-03-12 | evidence |
| Command-R+ (Apr '24) | Cohere | 0.118055555555556 | 2024-04-04 | evidence |
| DBRX Instruct | Databricks | 0.118055555555556 | 2024-03-27 | evidence |
| DeepHermes 3 - Llama-3.1 8B Preview (Non-reasoning) | Nous Research | 0.0914351851851852 | 2025-02-13 | evidence |
| DeepHermes 3 - Mistral 24B Preview (Non-reasoning) | Nous Research | 0.228009259259259 | 2025-03-13 | evidence |
| DeepSeek Coder V2 Lite Instruct | DeepSeek | 0.138888888888889 | 2024-06-17 | evidence |
| DeepSeek R1 (Jan '25) | DeepSeek | 0.357142857142857 | 2025-01-20 | evidence |
| DeepSeek R1 0528 (May '25) | DeepSeek | 0.402777777777778 | 2025-05-28 | evidence |
| DeepSeek R1 0528 Qwen3 8B | DeepSeek | 0.203703703703704 | 2025-05-29 | evidence |
| DeepSeek R1 Distill Llama 70B | DeepSeek | 0.3125 | 2025-01-20 | evidence |
| DeepSeek R1 Distill Llama 8B | DeepSeek | 0.118577075098814 | 2025-01-20 | evidence |
| DeepSeek R1 Distill Qwen 1.5B | DeepSeek | 0.0662251655629139 | 2025-01-20 | evidence |
| DeepSeek R1 Distill Qwen 14B | DeepSeek | 0.238683127572016 | 2025-01-20 | evidence |
| DeepSeek R1 Distill Qwen 32B | DeepSeek | 0.375690607734807 | 2025-01-20 | evidence |
| DeepSeek V3 (Dec '24) | DeepSeek | 0.354166666666667 | 2024-12-26 | evidence |
| DeepSeek V3 0324 | DeepSeek | 0.357638888888889 | 2025-03-25 | evidence |
| DeepSeek V3.1 (Non-reasoning) | DeepSeek | 0.366898148148148 | 2025-08-21 | evidence |
| DeepSeek V3.1 (Reasoning) | DeepSeek | 0.391203703703704 | 2025-08-21 | evidence |
| DeepSeek V3.1 Terminus (Non-reasoning) | DeepSeek | 0.320601851851852 | 2025-09-22 | evidence |
| DeepSeek V3.1 Terminus (Reasoning) | DeepSeek | 0.40625 | 2025-09-22 | evidence |
| DeepSeek V3.2 (Non-reasoning) | DeepSeek | 0.386574074074074 | 2025-12-01 | evidence |
| DeepSeek V3.2 (Reasoning) | DeepSeek | 0.388888888888889 | 2025-12-01 | evidence |
| DeepSeek V3.2 Exp (Non-reasoning) | DeepSeek | 0.399305555555556 | 2025-09-29 | evidence |
| DeepSeek V3.2 Exp (Reasoning) | DeepSeek | 0.377314814814815 | 2025-09-29 | evidence |
| DeepSeek V3.2 Speciale | DeepSeek | 0.439814814814815 | 2025-12-01 | evidence |
| DeepSeek V4 Flash (Non-reasoning) | DeepSeek | 0.372685185185185 | 2026-04-24 | evidence |
| DeepSeek V4 Flash (Reasoning, High Effort) | DeepSeek | 0.420138888888889 | 2026-04-24 | evidence |
| DeepSeek V4 Flash (Reasoning, Max Effort) | DeepSeek | 0.449074074074074 | 2026-04-24 | evidence |
| DeepSeek V4 Flash 0731 (Reasoning, Max Effort) | DeepSeek | 0.498842592592593 | 2026-07-31 | evidence |
| DeepSeek V4 Flash Vision (Reasoning, Max Effort) | DeepSeek | 0.466435185185185 | 2026-08-21 | evidence |
| DeepSeek V4 Pro (Non-reasoning) | DeepSeek | 0.423611111111111 | 2026-04-24 | evidence |
| DeepSeek V4 Pro (Reasoning, High Effort) | DeepSeek | 0.46412037037037 | 2026-04-24 | evidence |
| DeepSeek V4 Pro (Reasoning, Max Effort) | DeepSeek | 0.5 | 2026-04-24 | evidence |
| DeepSeek V4 Pro 0813 (Reasoning, Max Effort) | DeepSeek | 0.491898148148148 | 2026-08-13 | evidence |
| Devstral 2 | Mistral | 0.331018518518519 | 2025-12-09 | evidence |
| Devstral Medium | Mistral | 0.293981481481481 | 2025-07-10 | evidence |
| Devstral Small (Jul '25) | Mistral | 0.243055555555556 | 2025-07-10 | evidence |
| Devstral Small (May '25) | Mistral | 0.24537037037037 | 2025-05-21 | evidence |
| Devstral Small 2 | Mistral | 0.288194444444444 | 2025-12-09 | evidence |
| DiffusionGemma 26B A4B | 0.342592592592593 | 2026-06-10 | evidence | |
| Doubao Seed Code | ByteDance Seed | 0.407407407407407 | 2025-11-11 | evidence |
| ERNIE 4.5 300B A47B | Baidu | 0.314814814814815 | 2025-06-30 | evidence |
| ERNIE 5.0 Thinking Preview | Baidu | 0.375 | 2025-11-13 | evidence |
| Exaone 4.0 1.2B (Non-reasoning) | LG AI Research | 0.0740740740740741 | 2025-07-15 | evidence |
| Exaone 4.0 1.2B (Reasoning) | LG AI Research | 0.0925925925925926 | 2025-07-15 | evidence |
| EXAONE 4.0 32B (Non-reasoning) | LG AI Research | 0.252314814814815 | 2025-07-15 | evidence |
| EXAONE 4.0 32B (Reasoning) | LG AI Research | 0.34375 | 2025-07-15 | evidence |
| EXAONE 4.5 33B | LG AI Research | 0.280092592592593 | 2026-04-09 | evidence |
| Falcon-H1R-7B | TII UAE | 0.248842592592593 | 2026-01-04 | evidence |
| G9v3-39A5B | AI9Stars | 0.340277777777778 | 2026-08-20 | evidence |
| G9v3-3B | AI9Stars | 0.177083333333333 | 2026-07-23 | evidence |
| Gemini 1.0 Pro | 0.116898148148148 | 2023-12-06 | evidence | |
| Gemini 1.5 Flash (May '24) | 0.180555555555556 | 2024-05-14 | evidence | |
| Gemini 1.5 Flash (Sep '24) | 0.267361111111111 | 2024-09-24 | evidence | |
| Gemini 1.5 Flash-8B | 0.229166666666667 | 2024-10-03 | evidence | |
| Gemini 1.5 Pro (May '24) | 0.273590716878101 | 2024-05-15 | evidence | |
| Gemini 1.5 Pro (Sep '24) | 0.295138888888889 | 2024-09-24 | evidence | |
| Gemini 2.0 Flash (experimental) | 0.340277777777778 | 2024-12-11 | evidence | |
| Gemini 2.0 Flash (Feb '25) | 0.333333333333333 | 2025-02-05 | evidence | |
| Gemini 2.0 Flash Thinking Experimental (Jan '25) | 0.328621908127208 | 2025-01-21 | evidence | |
| Gemini 2.0 Flash-Lite (Feb '25) | 0.25 | 2025-02-25 | evidence | |
| Gemini 2.0 Flash-Lite (Preview) | 0.246527777777778 | 2025-02-05 | evidence | |
| Gemini 2.0 Pro Experimental (Feb '25) | 0.3125 | 2025-02-05 | evidence | |
| Gemini 2.5 Flash (Non-reasoning) | 0.290509259259259 | 2025-05-20 | evidence | |
| Gemini 2.5 Flash (Reasoning) | 0.393518518518519 | 2025-05-20 | evidence | |
| Gemini 2.5 Flash Preview (Non-reasoning) | 0.232638888888889 | 2025-04-17 | evidence | |
| Gemini 2.5 Flash Preview (Reasoning) | 0.358796296296296 | 2025-04-17 | evidence | |
| Gemini 2.5 Flash Preview (Sep '25) (Non-reasoning) | 0.375 | 2025-09-25 | evidence | |
| Gemini 2.5 Flash Preview (Sep '25) (Reasoning) | 0.405092592592593 | 2025-09-25 | evidence | |
| Gemini 2.5 Flash-Lite (Non-reasoning) | 0.177083333333333 | 2025-06-17 | evidence | |
| Gemini 2.5 Flash-Lite (Reasoning) | 0.193287037037037 | 2025-06-17 | evidence | |
| Gemini 2.5 Flash-Lite Preview (Sep '25) (Non-reasoning) | 0.284722222222222 | 2025-09-25 | evidence | |
| Gemini 2.5 Flash-Lite Preview (Sep '25) (Reasoning) | 0.287037037037037 | 2025-09-08 | evidence | |
| Gemini 2.5 Pro | 0.428240740740741 | 2025-06-05 | evidence | |
| Gemini 2.5 Pro Preview (Mar' 25) | 0.394675925925926 | 2025-03-25 | evidence | |
| Gemini 2.5 Pro Preview (May' 25) | 0.415509259259259 | 2025-05-06 | evidence | |
| Gemini 3 Flash Preview (Non-reasoning) | 0.498842592592593 | 2025-12-17 | evidence | |
| Gemini 3 Flash Preview (Reasoning) | 0.505787037037037 | 2025-12-17 | evidence | |
| Gemini 3 Pro Preview (high) | 0.561342592592593 | 2025-11-18 | evidence | |
| Gemini 3 Pro Preview (low) | 0.498842592592593 | 2025-11-18 | evidence | |
| Gemini 3.1 Flash-Lite | 0.418981481481481 | 2026-03-03 | evidence | |
| Gemini 3.1 Pro Preview | 0.58912037037037 | 2026-02-19 | evidence | |
| Gemini 3.5 Flash (high) | 0.53125 | 2026-05-19 | evidence | |
| Gemini 3.5 Flash (medium) | 0.530092592592593 | 2026-05-19 | evidence | |
| Gemini 3.5 Flash (minimal) | 0.488425925925926 | 2026-05-19 | evidence | |
| Gemini 3.5 Flash-Lite | 0.408564814814815 | 2026-07-21 | evidence | |
| Gemini 3.6 Flash (high) | 0.52662037037037 | 2026-07-21 | evidence | |
| Gemini 3.7 Flash (high) | 0.568287037037037 | 2026-08-13 | evidence | |
| Gemini 3.7 Flash (low) | 0.53587962962963 | 2026-08-13 | evidence | |
| Gemini 3.7 Flash (medium) | 0.578703703703704 | 2026-08-13 | evidence | |
| Gemma 3 12B Instruct | 0.173611111111111 | 2025-03-12 | evidence | |
| Gemma 3 1B Instruct | 0.00694444444444444 | 2025-03-13 | evidence | |
| Gemma 3 270M | 0 | 2025-08-14 | evidence | |
| Gemma 3 27B Instruct | 0.211805555555556 | 2025-03-12 | evidence | |
| Gemma 3 4B Instruct | 0.0729166666666667 | 2025-03-12 | evidence | |
| Gemma 3n E2B Instruct | 0.0520833333333333 | 2025-06-26 | evidence | |
| Gemma 3n E4B Instruct | 0.0810185185185185 | 2025-06-26 | evidence | |
| Gemma 3n E4B Instruct Preview (May '25) | 0.0856481481481481 | 2025-05-20 | evidence | |
| Gemma 4 12B (Non-reasoning) | 0.297453703703704 | 2026-06-03 | evidence | |
| Gemma 4 12B (Reasoning) | 0.381944444444444 | 2026-06-03 | evidence | |
| Gemma 4 26B A4B (Non-reasoning) | 0.372685185185185 | 2026-04-02 | evidence | |
| Gemma 4 26B A4B (Reasoning) | 0.400462962962963 | 2026-04-02 | evidence | |
| Gemma 4 31B (Non-reasoning) | 0.41087962962963 | 2026-04-02 | evidence | |
| Gemma 4 31B (Reasoning) | 0.434027777777778 | 2026-04-02 | evidence | |
| Gemma 4 E2B (Non-reasoning) | 0.203703703703704 | 2026-04-02 | evidence | |
| Gemma 4 E2B (Reasoning) | 0.209490740740741 | 2026-04-02 | evidence | |
| Gemma 4 E4B (Non-reasoning) | 0.0393518518518519 | 2026-04-03 | evidence | |
| Gemma 4 E4B (Reasoning) | 0.244212962962963 | 2026-04-03 | evidence | |
| GLM 5V Turbo (Reasoning) | Z.ai | 0.435185185185185 | 2026-04-01 | evidence |
| GLM-4.5 (Reasoning) | Z.ai | 0.34837962962963 | 2025-07-28 | evidence |
| GLM-4.5-Air | Z.ai | 0.305555555555556 | 2025-07-28 | evidence |
| GLM-4.5V (Non-reasoning) | Z.ai | 0.1875 | 2025-08-11 | evidence |
| GLM-4.5V (Reasoning) | Z.ai | 0.221064814814815 | 2025-08-11 | evidence |
| GLM-4.6 (Non-reasoning) | Z.ai | 0.331018518518519 | 2025-09-30 | evidence |
| GLM-4.6 (Reasoning) | Z.ai | 0.384259259259259 | 2025-09-30 | evidence |
| GLM-4.6V (Non-reasoning) | Z.ai | 0.271990740740741 | 2025-12-08 | evidence |
| GLM-4.6V (Reasoning) | Z.ai | 0.304398148148148 | 2025-12-08 | evidence |
| GLM-4.7 (Non-reasoning) | Z.ai | 0.354166666666667 | 2025-12-22 | evidence |
| GLM-4.7 (Reasoning) | Z.ai | 0.451388888888889 | 2025-12-22 | evidence |
| GLM-4.7-Flash (Non-reasoning) | Z.ai | 0.25462962962963 | 2026-01-19 | evidence |
| GLM-4.7-Flash (Reasoning) | Z.ai | 0.336805555555556 | 2026-01-19 | evidence |
| GLM-5 (Non-reasoning) | Z.ai | 0.383101851851852 | 2026-02-11 | evidence |
| GLM-5 (Reasoning) | Z.ai | 0.461805555555556 | 2026-02-11 | evidence |
| GLM-5-Turbo | Z.ai | 0.436342592592593 | 2026-03-15 | evidence |
| GLM-5.1 (Non-reasoning) | Z.ai | 0.361111111111111 | 2026-04-07 | evidence |
| GLM-5.1 (Reasoning) | Z.ai | 0.4375 | 2026-04-07 | evidence |
| GLM-5.2 (max) | Z.ai | 0.50462962962963 | 2026-06-16 | evidence |
| GLM-5.2 (Non-reasoning) | Z.ai | 0.361111111111111 | 2026-06-16 | evidence |
| GLM-5.3 (max) | Z.ai | 0.564814814814815 | 2026-08-18 | evidence |
| GPT-4 Turbo | OpenAI | 0.319444444444444 | 2023-11-06 | evidence |
| GPT-4.1 | OpenAI | 0.380787037037037 | 2025-04-14 | evidence |
| GPT-4.1 mini | OpenAI | 0.403935185185185 | 2025-04-14 | evidence |
| GPT-4.1 nano | OpenAI | 0.259259259259259 | 2025-04-14 | evidence |
| GPT-4o (Aug '24) | OpenAI | 0.331018518518519 | 2024-08-06 | evidence |
| GPT-4o (ChatGPT) | OpenAI | 0.334490740740741 | 2025-02-15 | evidence |
| GPT-4o (March 2025, chatgpt-4o-latest) | OpenAI | 0.365740740740741 | 2025-03-27 | evidence |
| GPT-4o (May '24) | OpenAI | 0.309027777777778 | 2024-05-13 | evidence |
| GPT-4o (Nov '24) | OpenAI | 0.333333333333333 | 2024-11-20 | evidence |
| GPT-4o mini | OpenAI | 0.229166666666667 | 2024-07-18 | evidence |
| GPT-5 (ChatGPT) | OpenAI | 0.378472222222222 | 2025-08-07 | evidence |
| GPT-5 (high) | OpenAI | 0.429398148148148 | 2025-08-07 | evidence |
| GPT-5 (low) | OpenAI | 0.391203703703704 | 2025-08-07 | evidence |
| GPT-5 (medium) | OpenAI | 0.41087962962963 | 2025-08-07 | evidence |
| GPT-5 (minimal) | OpenAI | 0.387731481481481 | 2025-08-07 | evidence |
| GPT-5 Codex (high) | OpenAI | 0.408564814814815 | 2025-09-23 | evidence |
| GPT-5 mini (high) | OpenAI | 0.392361111111111 | 2025-08-07 | evidence |
| GPT-5 mini (medium) | OpenAI | 0.409722222222222 | 2025-08-07 | evidence |
| GPT-5 mini (minimal) | OpenAI | 0.369212962962963 | 2025-08-07 | evidence |
| GPT-5 nano (high) | OpenAI | 0.365740740740741 | 2025-08-07 | evidence |
| GPT-5 nano (medium) | OpenAI | 0.337962962962963 | 2025-08-07 | evidence |
| GPT-5 nano (minimal) | OpenAI | 0.290509259259259 | 2025-08-07 | evidence |
| GPT-5.1 (high) | OpenAI | 0.43287037037037 | 2025-11-13 | evidence |
| GPT-5.1 (Non-reasoning) | OpenAI | 0.364583333333333 | 2025-11-13 | evidence |
| GPT-5.1 Codex (high) | OpenAI | 0.40162037037037 | 2025-11-13 | evidence |
| GPT-5.1 Codex mini (high) | OpenAI | 0.425925925925926 | 2025-11-13 | evidence |
| GPT-5.2 (medium) | OpenAI | 0.461805555555556 | 2025-12-11 | evidence |
| GPT-5.2 (Non-reasoning) | OpenAI | 0.403935185185185 | 2025-12-11 | evidence |
| GPT-5.2 (xhigh) | OpenAI | 0.520833333333333 | 2025-12-11 | evidence |
| GPT-5.2 Codex (xhigh) | OpenAI | 0.546296296296296 | 2025-12-11 | evidence |
| GPT-5.3 Codex (xhigh) | OpenAI | 0.532407407407407 | 2026-02-05 | evidence |
| GPT-5.4 (low) | OpenAI | 0.503472222222222 | 2026-03-05 | evidence |
| GPT-5.4 (Non-reasoning) | OpenAI | 0.471064814814815 | 2026-03-05 | evidence |
| GPT-5.4 (xhigh) | OpenAI | 0.565972222222222 | 2026-03-05 | evidence |
| GPT-5.4 mini (medium) | OpenAI | 0.44212962962963 | 2026-03-17 | evidence |
| GPT-5.4 mini (Non-Reasoning) | OpenAI | 0.395833333333333 | 2026-03-17 | evidence |
| GPT-5.4 mini (xhigh) | OpenAI | 0.498842592592593 | 2026-03-17 | evidence |
| GPT-5.4 nano (medium) | OpenAI | 0.384259259259259 | 2026-03-17 | evidence |
| GPT-5.4 nano (Non-Reasoning) | OpenAI | 0.351851851851852 | 2026-03-17 | evidence |
| GPT-5.4 nano (xhigh) | OpenAI | 0.46875 | 2026-03-17 | evidence |
| GPT-5.5 (high) | OpenAI | 0.559027777777778 | 2026-04-23 | evidence |
| GPT-5.5 (low) | OpenAI | 0.516203703703704 | 2026-04-23 | evidence |
| GPT-5.5 (medium) | OpenAI | 0.534722222222222 | 2026-04-23 | evidence |
| GPT-5.5 (Non-reasoning) | OpenAI | 0.47337962962963 | 2026-04-23 | evidence |
| GPT-5.5 (xhigh) | OpenAI | 0.561342592592593 | 2026-04-23 | evidence |
| GPT-5.5 Instant (June 2026) | OpenAI | 0.486111111111111 | 2026-06-25 | evidence |
| GPT-5.5 Instant (May 2026) | OpenAI | 0.503472222222222 | 2026-05-05 | evidence |
| GPT-5.6 Luna (high) | OpenAI | 0.506944444444444 | 2026-07-09 | evidence |
| GPT-5.6 Luna (low) | OpenAI | 0.456018518518519 | 2026-07-09 | evidence |
| GPT-5.6 Luna (max) | OpenAI | 0.525462962962963 | 2026-07-09 | evidence |
| GPT-5.6 Luna (medium) | OpenAI | 0.458333333333333 | 2026-07-09 | evidence |
| GPT-5.6 Luna (Non-reasoning) | OpenAI | 0.399305555555556 | 2026-07-09 | evidence |
| GPT-5.6 Luna (xhigh) | OpenAI | 0.5 | 2026-07-09 | evidence |
| GPT-5.6 Sol (high) | OpenAI | 0.569444444444444 | 2026-07-09 | evidence |
| GPT-5.6 Sol (low) | OpenAI | 0.554398148148148 | 2026-07-09 | evidence |
| GPT-5.6 Sol (max) | OpenAI | 0.561342592592593 | 2026-07-09 | evidence |
| GPT-5.6 Sol (medium) | OpenAI | 0.564814814814815 | 2026-07-09 | evidence |
| GPT-5.6 Sol (Non-reasoning) | OpenAI | 0.471064814814815 | 2026-07-09 | evidence |
| GPT-5.6 Sol (xhigh) | OpenAI | 0.560185185185185 | 2026-07-09 | evidence |
| GPT-5.6 Terra (high) | OpenAI | 0.501157407407407 | 2026-07-09 | evidence |
| GPT-5.6 Terra (low) | OpenAI | 0.491898148148148 | 2026-07-09 | evidence |
| GPT-5.6 Terra (max) | OpenAI | 0.539351851851852 | 2026-07-09 | evidence |
| GPT-5.6 Terra (medium) | OpenAI | 0.496527777777778 | 2026-07-09 | evidence |
| GPT-5.6 Terra (Non-reasoning) | OpenAI | 0.445601851851852 | 2026-07-09 | evidence |
| GPT-5.6 Terra (xhigh) | OpenAI | 0.516203703703704 | 2026-07-09 | evidence |
| gpt-oss-120b (high) | OpenAI | 0.388888888888889 | 2025-08-05 | evidence |
| gpt-oss-120b (low) | OpenAI | 0.359953703703704 | 2025-08-05 | evidence |
| gpt-oss-20b (high) | OpenAI | 0.34375 | 2025-08-05 | evidence |
| gpt-oss-20b (low) | OpenAI | 0.340277777777778 | 2025-08-05 | evidence |
| Granite 3.3 8B (Non-reasoning) | IBM | 0.100694444444444 | 2025-04-16 | evidence |
| Granite 4.0 1B | IBM | 0.0868055555555556 | 2025-10-28 | evidence |
| Granite 4.0 350M | IBM | 0.00925925925925926 | 2025-10-28 | evidence |
| Granite 4.0 H 1B | IBM | 0.0821759259259259 | 2025-10-28 | evidence |
| Granite 4.0 H 350M | IBM | 0.0173611111111111 | 2025-10-28 | evidence |
| Granite 4.0 H Small | IBM | 0.209490740740741 | 2025-09-22 | evidence |
| Granite 4.0 Micro | IBM | 0.119212962962963 | 2025-09-22 | evidence |
| Granite 4.1 30B | IBM | 0.258101851851852 | 2026-04-29 | evidence |
| Granite 4.1 3B | IBM | 0.119212962962963 | 2026-04-29 | evidence |
| Granite 4.1 8B | IBM | 0.217592592592593 | 2026-04-29 | evidence |
| Grok 2 (Dec '24) | xAI | 0.284722222222222 | 2024-12-12 | evidence |
| Grok 3 | xAI | 0.368055555555556 | 2025-02-19 | evidence |
| Grok 3 mini Reasoning (high) | xAI | 0.40625 | 2025-02-19 | evidence |
| Grok 4 | xAI | 0.457175925925926 | 2025-07-10 | evidence |
| Grok 4 Fast (Non-reasoning) | xAI | 0.328703703703704 | 2025-09-19 | evidence |
| Grok 4 Fast (Reasoning) | xAI | 0.44212962962963 | 2025-09-19 | evidence |
| Grok 4.1 Fast (Non-reasoning) | xAI | 0.296296296296296 | 2025-11-19 | evidence |
| Grok 4.1 Fast (Reasoning) | xAI | 0.44212962962963 | 2025-11-19 | evidence |
| Grok 4.20 0309 (Non-reasoning) | xAI | 0.321759259259259 | 2026-03-10 | evidence |
| Grok 4.20 0309 (Reasoning) | xAI | 0.446759259259259 | 2026-03-10 | evidence |
| Grok 4.20 0309 v2 (Non-reasoning) | xAI | 0.327546296296296 | 2026-04-07 | evidence |
| Grok 4.20 0309 v2 (Reasoning) | xAI | 0.456018518518519 | 2026-04-07 | evidence |
| Grok 4.3 (high) | xAI | 0.47337962962963 | 2026-04-30 | evidence |
| Grok 4.3 (low) | xAI | 0.418981481481481 | 2026-04-30 | evidence |
| Grok 4.3 (medium) | xAI | 0.445601851851852 | 2026-04-30 | evidence |
| Grok 4.3 (Non-reasoning) | xAI | 0.373842592592593 | 2026-04-30 | evidence |
| Grok 4.5 (high) | xAI | 0.540509259259259 | 2026-07-08 | evidence |
| Grok 4.6 (high) | xAI | 0.53587962962963 | 2026-08-12 | evidence |
| Grok 4.6 (low) | xAI | 0.483796296296296 | 2026-08-12 | evidence |
| Grok 4.6 (medium) | xAI | 0.546296296296296 | 2026-08-12 | evidence |
| Grok 4.6 (xhigh) | xAI | 0.516203703703704 | 2026-08-12 | evidence |
| Grok Beta | xAI | 0.295138888888889 | 2024-08-13 | evidence |
| Grok Build 0.1 0616 | xAI | 0.502314814814815 | 2026-06-16 | evidence |
| Grok Code Fast 1 | xAI | 0.362268518518518 | 2025-08-28 | evidence |
| Hermes 3 - Llama-3.1 70B | Nous Research | 0.231481481481481 | 2024-08-15 | evidence |
| Hermes 4 - Llama-3.1 405B (Non-reasoning) | Nous Research | 0.346064814814815 | 2025-08-27 | evidence |
| Hermes 4 - Llama-3.1 405B (Reasoning) | Nous Research | 0.252314814814815 | 2025-08-27 | evidence |
| Hermes 4 - Llama-3.1 70B (Non-reasoning) | Nous Research | 0.27662037037037 | 2025-08-27 | evidence |
| Hermes 4 - Llama-3.1 70B (Reasoning) | Nous Research | 0.341435185185185 | 2025-08-27 | evidence |
| Hy3 | Tencent | 0.475694444444444 | 2026-07-06 | evidence |
| Hy3-preview (Non-reasoning) | Tencent | 0.393518518518519 | 2026-04-23 | evidence |
| Hy3-preview (Reasoning) | Tencent | 0.412037037037037 | 2026-04-23 | evidence |
| HyperCLOVA X SEED Think (32B) | Naver | 0.283564814814815 | 2025-12-26 | evidence |
| HyperNova 60B 2605 | Multiverse Computing | 0.329861111111111 | 2026-05-26 | evidence |
| Inkling (xhigh) | Thinking Machines | 0.460648148148148 | 2026-07-15 | evidence |
| Inkling Small | Thinking Machines | 0.487268518518519 | 2026-07-30 | evidence |
| INTELLECT-3 | Prime Intellect | 0.391203703703704 | 2025-11-27 | evidence |
| Jamba 1.5 Large | AI21 Labs | 0.163194444444444 | 2024-08-22 | evidence |
| Jamba 1.5 Mini | AI21 Labs | 0.0798611111111111 | 2024-08-22 | evidence |
| Jamba 1.6 Large | AI21 Labs | 0.184027777777778 | 2025-03-06 | evidence |
| Jamba 1.6 Mini | AI21 Labs | 0.100694444444444 | 2025-03-06 | evidence |
| Jamba 1.7 Large | AI21 Labs | 0.1875 | 2025-07-07 | evidence |
| Jamba 1.7 Mini | AI21 Labs | 0.0925925925925926 | 2025-07-07 | evidence |
| Jamba Reasoning 3B | AI21 Labs | 0.0590277777777778 | 2025-10-08 | evidence |
| JT-35B-Flash | China Mobile | 0.290509259259259 | 2026-05-14 | evidence |
| JT-4.1 Flash 236B A21B | China Mobile | 0.381944444444444 | 2026-07-09 | evidence |
| JT-MINI | China Mobile | 0.271990740740741 | 2026-04-15 | evidence |
| K-EXAONE (Non-reasoning) | LG AI Research | 0.269675925925926 | 2025-12-31 | evidence |
| K-EXAONE (Reasoning) | LG AI Research | 0.356481481481481 | 2025-12-31 | evidence |
| K-EXAONE 2.0 0803 | LG AI Research | 0.409722222222222 | 2026-08-12 | evidence |
| K2 Think V2 | MBZUAI Institute of Foundation Models | 0.329861111111111 | 2025-12-15 | evidence |
| K2-V2 (high) | MBZUAI Institute of Foundation Models | 0.28587962962963 | 2025-12-05 | evidence |
| K2-V2 (low) | MBZUAI Institute of Foundation Models | 0.22337962962963 | 2025-12-05 | evidence |
| K2-V2 (medium) | MBZUAI Institute of Foundation Models | 0.252314814814815 | 2025-12-05 | evidence |
| KAT Coder Pro V2 | KwaiKAT | 0.383101851851852 | 2026-03-27 | evidence |
| KAT-Coder-Pro V1 | KwaiKAT | 0.365740740740741 | 2025-11-11 | evidence |
| Kimi K2 | Moonshot AI | 0.344907407407407 | 2025-07-11 | evidence |
| Kimi K2 0905 | Moonshot AI | 0.306712962962963 | 2025-09-05 | evidence |
| Kimi K2 Thinking | Moonshot AI | 0.423611111111111 | 2025-11-06 | evidence |
| Kimi K2.5 (Non-reasoning) | Moonshot AI | 0.395833333333333 | 2026-01-27 | evidence |
| Kimi K2.5 (Reasoning) | Moonshot AI | 0.489583333333333 | 2026-01-27 | evidence |
| Kimi K2.6 | Moonshot AI | 0.534722222222222 | 2026-04-20 | evidence |
| Kimi K2.6 (Non-reasoning) | Moonshot AI | 0.394675925925926 | 2026-04-20 | evidence |
| Kimi K2.7 Code | Moonshot AI | 0.474537037037037 | 2026-06-12 | evidence |
| Kimi K3 (low) | Moonshot AI | 0.511574074074074 | 2026-07-16 | evidence |
| Kimi K3 (max) | Moonshot AI | 0.586805555555556 | 2026-07-16 | evidence |
| Kimi Linear 48B A3B Instruct | Moonshot AI | 0.199074074074074 | 2025-10-30 | evidence |
| LFM 40B | Liquid AI | 0.0706018518518518 | 2024-09-30 | evidence |
| LFM2 1.2B | Liquid AI | 0.025462962962963 | 2025-07-10 | evidence |
| LFM2 2.6B | Liquid AI | 0.025462962962963 | 2025-09-23 | evidence |
| LFM2 24B A2B | Liquid AI | 0.108796296296296 | 2026-02-25 | evidence |
| LFM2 8B A1B | Liquid AI | 0.068287037037037 | 2025-10-07 | evidence |
| LFM2.5-1.2B-Instruct | Liquid AI | 0.0231481481481481 | 2026-01-05 | evidence |
| LFM2.5-1.2B-Thinking | Liquid AI | 0.0416666666666667 | 2026-01-20 | evidence |
| LFM2.5-2.6B | Liquid AI | 0.142361111111111 | 2026-08-04 | evidence |
| LFM2.5-8B-A1B | Liquid AI | 0.0775462962962963 | 2026-05-28 | evidence |
| LFM2.5-VL-1.6B | Liquid AI | 0.0300925925925926 | 2026-01-05 | evidence |
| Ling 2.6 Flash | InclusionAI | 0.270833333333333 | 2026-04-21 | evidence |
| Ling 3.0 Flash | InclusionAI | 0.41087962962963 | 2026-08-04 | evidence |
| Ling 3.0 Tiny | InclusionAI | 0.241898148148148 | 2026-08-06 | evidence |
| Ling-1T | InclusionAI | 0.351851851851852 | 2025-10-08 | evidence |
| Ling-2.6-1T | InclusionAI | 0.37037037037037 | 2026-04-23 | evidence |
| Ling-flash-2.0 | InclusionAI | 0.289351851851852 | 2025-09-17 | evidence |
| Ling-mini-2.0 | InclusionAI | 0.135416666666667 | 2025-09-09 | evidence |
| Llama 2 Chat 13B | Meta | 0.118055555555556 | 2023-07-18 | evidence |
| Llama 2 Chat 7B | Meta | 0 | 2023-07-18 | evidence |
| Llama 3 Instruct 70B | Meta | 0.188598051724984 | 2024-04-18 | evidence |
| Llama 3 Instruct 8B | Meta | 0.119402985074627 | 2024-04-18 | evidence |
| Llama 3.1 Instruct 405B | Meta | 0.298611111111111 | 2024-07-23 | evidence |
| Llama 3.1 Instruct 70B | Meta | 0.267361111111111 | 2024-07-23 | evidence |
| Llama 3.1 Instruct 8B | Meta | 0.131944444444444 | 2024-07-23 | evidence |
| Llama 3.1 Nemotron Instruct 70B | NVIDIA | 0.232638888888889 | 2024-10-15 | evidence |
| Llama 3.1 Nemotron Nano 4B v1.1 (Reasoning) | NVIDIA | 0.100694444444444 | 2025-05-20 | evidence |
| Llama 3.1 Nemotron Ultra 253B v1 (Reasoning) | NVIDIA | 0.347222222222222 | 2025-04-07 | evidence |
| Llama 3.1 Tulu3 405B | Allen Institute for AI | 0.302083333333333 | 2025-01-30 | evidence |
| Llama 3.2 Instruct 11B (Vision) | Meta | 0.112268518518519 | 2024-09-25 | evidence |
| Llama 3.2 Instruct 1B | Meta | 0.0173611111111111 | 2024-09-25 | evidence |
| Llama 3.2 Instruct 3B | Meta | 0.0520833333333333 | 2024-09-25 | evidence |
| Llama 3.2 Instruct 90B (Vision) | Meta | 0.239583333333333 | 2024-09-25 | evidence |
| Llama 3.3 Instruct 70B | Meta | 0.260416666666667 | 2024-12-06 | evidence |
| Llama 3.3 Nemotron Super 49B v1 (Non-reasoning) | NVIDIA | 0.229166666666667 | 2025-03-18 | evidence |
| Llama 3.3 Nemotron Super 49B v1 (Reasoning) | NVIDIA | 0.282407407407407 | 2025-03-18 | evidence |
| Llama 4 Maverick | Meta | 0.331018518518519 | 2025-04-05 | evidence |
| Llama 4 Scout | Meta | 0.170138888888889 | 2025-04-05 | evidence |
| Llama Nemotron Super 49B v1.5 (Non-reasoning) | NVIDIA | 0.238425925925926 | 2025-07-25 | evidence |
| Llama Nemotron Super 49B v1.5 (Reasoning) | NVIDIA | 0.34837962962963 | 2025-07-25 | evidence |
| LongCat 2.0 | LongCat | 0.354166666666667 | 2026-06-29 | evidence |
| LongCat Flash Lite | LongCat | 0.283564814814815 | 2026-01-28 | evidence |
| Magistral Medium 1 | Mistral | 0.296875 | 2025-06-10 | evidence |
| Magistral Medium 1.2 | Mistral | 0.392361111111111 | 2025-09-18 | evidence |
| Magistral Small 1 | Mistral | 0.240740740740741 | 2025-06-10 | evidence |
| Magistral Small 1.2 | Mistral | 0.351851851851852 | 2025-09-17 | evidence |
| Mercury 2 | Inception | 0.386574074074074 | 2026-02-20 | evidence |
| Mi:dm K 2.5 Pro | Korea Telecom | 0.331597222222222 | 2025-12-11 | evidence |
| Mi:dm K 2.5 Pro Preview | Korea Telecom | 0.297453703703704 | 2025-12-11 | evidence |
| MiMo-V2-Flash (Feb 2026) | Xiaomi | 0.383101851851852 | 2025-12-16 | evidence |
| MiMo-V2-Flash (Non-reasoning) | Xiaomi | 0.259259259259259 | 2025-12-16 | evidence |
| MiMo-V2-Flash (Reasoning) | Xiaomi | 0.393518518518518 | 2025-12-16 | evidence |
| MiMo-V2-Omni | Xiaomi | 0.366898148148148 | 2026-03-19 | evidence |
| MiMo-V2-Omni-0327 | Xiaomi | 0.394675925925926 | 2026-03-27 | evidence |
| MiMo-V2-Pro | Xiaomi | 0.424768518518519 | 2026-03-18 | evidence |
| MiMo-V2.5 | Xiaomi | 0.430555555555556 | 2026-04-22 | evidence |
| MiMo-V2.5-Pro | Xiaomi | 0.502314814814815 | 2026-04-22 | evidence |
| MiMo-V2.5-Pro (Non-reasoning) | Xiaomi | 0.391203703703704 | 2026-04-22 | evidence |
| MiniCPM-V 4.6 1.3B | OpenBMB | 0.0208333333333333 | 2026-05-11 | evidence |
| MiniCPM5-1B (Non-reasoning) | OpenBMB | 0.0138888888888889 | 2026-05-25 | evidence |
| MiniCPM5-1B (Reasoning) | OpenBMB | 0.0439814814814815 | 2026-05-25 | evidence |
| MiniMax M1 40k | MiniMax | 0.378472222222222 | 2025-06-17 | evidence |
| MiniMax M1 80k | MiniMax | 0.373842592592593 | 2025-06-17 | evidence |
| MiniMax-M2 | MiniMax | 0.361111111111111 | 2025-10-26 | evidence |
| MiniMax-M2.1 | MiniMax | 0.407407407407407 | 2025-12-23 | evidence |
| MiniMax-M2.5 | MiniMax | 0.425925925925926 | 2026-02-12 | evidence |
| MiniMax-M2.7 | MiniMax | 0.469907407407407 | 2026-03-18 | evidence |
| MiniMax-M3 | MiniMax | 0.453703703703704 | 2026-06-01 | evidence |
| Ministral 3 14B | Mistral | 0.236111111111111 | 2025-12-02 | evidence |
| Ministral 3 3B | Mistral | 0.143518518518519 | 2025-12-02 | evidence |
| Ministral 3 8B | Mistral | 0.208333333333333 | 2025-12-02 | evidence |
| Mistral 7B Instruct | Mistral | 0.0243055555555556 | 2023-09-27 | evidence |
| Mistral Large (Feb '24) | Mistral | 0.208333333333333 | 2024-02-26 | evidence |
| Mistral Large 2 (Jul '24) | Mistral | 0.270833333333333 | 2024-07-24 | evidence |
| Mistral Large 2 (Nov '24) | Mistral | 0.291666666666667 | 2024-11-18 | evidence |
| Mistral Large 3 | Mistral | 0.362268518518519 | 2025-12-02 | evidence |
| Mistral Medium | Mistral | 0.118055555555556 | 2023-12-11 | evidence |
| Mistral Medium 3 | Mistral | 0.331018518518519 | 2025-05-07 | evidence |
| Mistral Medium 3.1 | Mistral | 0.337962962962963 | 2025-08-12 | evidence |
| Mistral Medium 3.5 | Mistral | 0.395833333333333 | 2026-04-29 | evidence |
| Mistral Saba | Mistral | 0.240740740740741 | 2025-02-17 | evidence |
| Mistral Small (Feb '24) | Mistral | 0.134259259259259 | 2024-02-26 | evidence |
| Mistral Small (Sep '24) | Mistral | 0.15625 | 2024-09-17 | evidence |
| Mistral Small 3 | Mistral | 0.236111111111111 | 2025-01-30 | evidence |
| Mistral Small 3.1 | Mistral | 0.265046296296296 | 2025-03-17 | evidence |
| Mistral Small 3.2 | Mistral | 0.263888888888889 | 2025-06-20 | evidence |
| Mistral Small 4 (Non-reasoning) | Mistral | 0.28125 | 2026-03-16 | evidence |
| Mistral Small 4 (Reasoning) | Mistral | 0.37962962962963 | 2026-03-16 | evidence |
| Mixtral 8x22B Instruct | Mistral | 0.1875 | 2024-04-17 | evidence |
| Mixtral 8x7B Instruct | Mistral | 0.0277777777777778 | 2023-12-11 | evidence |
| Molmo 7B-D | Allen Institute for AI | 0.0358796296296296 | 2024-09-25 | evidence |
| Molmo2-8B | Allen Institute for AI | 0.133101851851852 | 2025-12-11 | evidence |
| Motif 3 | Motif Technologies | 0.40625 | 2026-08-12 | evidence |
| Motif 3 (Beta) | Motif Technologies | 0.443287037037037 | 2026-07-14 | evidence |
| Motif-2-12.7B-Reasoning | Motif Technologies | 0.282407407407407 | 2025-12-04 | evidence |
| Muse Glimmer (high) | Meta | 0.436342592592593 | 2026-08-10 | evidence |
| Muse Spark | Meta | 0.515046296296296 | 2026-04-08 | evidence |
| Muse Spark 1.1 (xhigh) | Meta | 0.582175925925926 | 2026-07-09 | evidence |
| Muse Spark 1.2 (xhigh) | Meta | 0.563657407407407 | 2026-08-05 | evidence |
| Nanbeige4.1-3B | Nanbeige | 0.26598440545809 | 2026-02-11 | evidence |
| Nemotron 3 Nano Omni 30B A3B Reasoning | NVIDIA | 0.277777777777778 | 2026-04-29 | evidence |
| Nemotron 3 Super 120B A12B (Reasoning) | NVIDIA | 0.359953703703704 | 2026-03-11 | evidence |
| Nemotron 3 Ultra 550B A55B (Reasoning) | NVIDIA | 0.399305555555556 | 2026-06-04 | evidence |
| Nemotron 3.5 Lightning | NVIDIA | 0.315972222222222 | 2026-08-11 | evidence |
| Nemotron Cascade 2 30B A3B | NVIDIA | 0.34837962962963 | 2026-03-19 | evidence |
| Nex-N2-Pro | Nex AGI | 0.417824074074074 | 2026-06-02 | evidence |
| North Mini Code | Cohere | 0.381944444444444 | 2026-06-09 | evidence |
| Nova 2.0 Lite (high) | Amazon | 0.369212962962963 | 2025-10-29 | evidence |
| Nova 2.0 Lite (low) | Amazon | 0.333333333333333 | 2025-10-29 | evidence |
| Nova 2.0 Lite (medium) | Amazon | 0.368055555555556 | 2025-10-29 | evidence |
| Nova 2.0 Lite (Non-reasoning) | Amazon | 0.239583333333333 | 2025-10-29 | evidence |
| Nova 2.0 Omni (low) | Amazon | 0.342592592592593 | 2025-11-26 | evidence |
| Nova 2.0 Omni (medium) | Amazon | 0.362268518518519 | 2025-11-26 | evidence |
| Nova 2.0 Omni (Non-reasoning) | Amazon | 0.278935185185185 | 2025-11-26 | evidence |
| Nova 2.0 Pro Preview (low) | Amazon | 0.386574074074074 | 2025-11-27 | evidence |
| Nova 2.0 Pro Preview (medium) | Amazon | 0.427083333333333 | 2025-11-27 | evidence |
| Nova 2.0 Pro Preview (Non-reasoning) | Amazon | 0.28125 | 2025-11-27 | evidence |
| Nova Lite | Amazon | 0.138888888888889 | 2024-12-03 | evidence |
| Nova Micro | Amazon | 0.09375 | 2024-12-03 | evidence |
| Nova Premier | Amazon | 0.278935185185185 | 2025-04-30 | evidence |
| Nova Pro | Amazon | 0.208333333333333 | 2024-12-03 | evidence |
| NVIDIA Nemotron 3 Nano 30B A3B (Non-reasoning) | NVIDIA | 0.230324074074074 | 2025-12-15 | evidence |
| NVIDIA Nemotron 3 Nano 30B A3B (Reasoning) | NVIDIA | 0.296296296296296 | 2025-12-15 | evidence |
| NVIDIA Nemotron 3 Nano 4B | NVIDIA | 0.164351851851852 | 2026-03-16 | evidence |
| NVIDIA Nemotron Nano 12B v2 VL (Non-reasoning) | NVIDIA | 0.175925925925926 | 2025-10-28 | evidence |
| NVIDIA Nemotron Nano 12B v2 VL (Reasoning) | NVIDIA | 0.261574074074074 | 2025-10-28 | evidence |
| NVIDIA Nemotron Nano 9B V2 (Non-reasoning) | NVIDIA | 0.209490740740741 | 2025-08-18 | evidence |
| NVIDIA Nemotron Nano 9B V2 (Reasoning) | NVIDIA | 0.219907407407407 | 2025-08-18 | evidence |
| o1 | OpenAI | 0.357638888888889 | 2024-12-05 | evidence |
| o1-mini | OpenAI | 0.322916666666667 | 2024-09-12 | evidence |
| o3 | OpenAI | 0.409722222222222 | 2025-04-16 | evidence |
| o3-mini | OpenAI | 0.399305555555556 | 2025-01-31 | evidence |
| o3-mini (high) | OpenAI | 0.397856419092825 | 2025-01-31 | evidence |
| o4-mini (high) | OpenAI | 0.465277777777778 | 2025-04-16 | evidence |
| OLMo 2 32B | Allen Institute for AI | 0.0798611111111111 | 2025-03-13 | evidence |
| OLMo 2 7B | Allen Institute for AI | 0.037037037037037 | 2024-11-26 | evidence |
| Olmo 3 32B Think | Allen Institute for AI | 0.28587962962963 | 2025-11-20 | evidence |
| Olmo 3 7B Instruct | Allen Institute for AI | 0.103009259259259 | 2025-11-20 | evidence |
| Olmo 3 7B Think | Allen Institute for AI | 0.211805555555556 | 2025-11-20 | evidence |
| Olmo 3.1 32B Instruct | Allen Institute for AI | 0.166666666666667 | 2026-01-13 | evidence |
| Olmo 3.1 32B Think | Allen Institute for AI | 0.292824074074074 | 2025-12-12 | evidence |
| Phi-3 Mini Instruct 3.8B | Microsoft | 0.0902777777777778 | 2024-04-23 | evidence |
| Phi-4 | Microsoft | 0.260416666666667 | 2024-12-12 | evidence |
| Phi-4 Mini Instruct | Microsoft | 0.107638888888889 | 2024-02-26 | evidence |
| Phi-4 Multimodal Instruct | Microsoft | 0.109953703703704 | 2025-02-26 | evidence |
| Pixtral Large | Mistral | 0.291666666666667 | 2024-11-18 | evidence |
| Qwen2 Instruct 72B | Qwen | 0.229166666666667 | 2024-06-07 | evidence |
| Qwen2.5 Coder Instruct 32B | Qwen | 0.270833333333333 | 2024-11-11 | evidence |
| Qwen2.5 Coder Instruct 7B | Qwen | 0.148148148148148 | 2024-09-19 | evidence |
| Qwen2.5 Instruct 32B | Qwen | 0.229166666666667 | 2024-09-19 | evidence |
| Qwen2.5 Instruct 72B | Qwen | 0.267361111111111 | 2024-09-19 | evidence |
| Qwen2.5 Max | Qwen | 0.336805555555556 | 2025-01-28 | evidence |
| Qwen2.5 Turbo | Qwen | 0.152777777777778 | 2024-11-18 | evidence |
| Qwen3 0.6B (Non-reasoning) | Qwen | 0.0405092592592593 | 2025-04-28 | evidence |
| Qwen3 0.6B (Reasoning) | Qwen | 0.0277777777777778 | 2025-04-28 | evidence |
| Qwen3 1.7B (Non-reasoning) | Qwen | 0.0694444444444444 | 2025-04-28 | evidence |
| Qwen3 1.7B (Reasoning) | Qwen | 0.0428240740740741 | 2025-04-28 | evidence |
| Qwen3 14B (Non-reasoning) | Qwen | 0.265046296296296 | 2025-04-28 | evidence |
| Qwen3 14B (Reasoning) | Qwen | 0.315972222222222 | 2025-04-28 | evidence |
| Qwen3 235B A22B (Non-reasoning) | Qwen | 0.298611111111111 | 2025-04-28 | evidence |
| Qwen3 235B A22B (Reasoning) | Qwen | 0.399305555555556 | 2025-04-28 | evidence |
| Qwen3 235B A22B 2507 (Reasoning) | Qwen | 0.423611111111111 | 2025-07-25 | evidence |
| Qwen3 235B A22B 2507 Instruct | Qwen | 0.359953703703704 | 2025-07-21 | evidence |
| Qwen3 30B A3B (Non-reasoning) | Qwen | 0.263888888888889 | 2025-04-28 | evidence |
| Qwen3 30B A3B (Reasoning) | Qwen | 0.284722222222222 | 2025-04-28 | evidence |
| Qwen3 30B A3B 2507 (Reasoning) | Qwen | 0.333333333333333 | 2025-07-30 | evidence |
| Qwen3 30B A3B 2507 Instruct | Qwen | 0.304398148148148 | 2025-07-29 | evidence |
| Qwen3 32B (Non-reasoning) | Qwen | 0.280092592592593 | 2025-04-28 | evidence |
| Qwen3 32B (Reasoning) | Qwen | 0.354166666666667 | 2025-04-28 | evidence |
| Qwen3 4B (Non-reasoning) | Qwen | 0.166666666666667 | 2025-04-28 | evidence |
| Qwen3 4B (Reasoning) | Qwen | 0.0347222222222222 | 2025-04-28 | evidence |
| Qwen3 4B 2507 (Reasoning) | Qwen | 0.255787037037037 | 2025-08-06 | evidence |
| Qwen3 4B 2507 Instruct | Qwen | 0.180555555555556 | 2025-08-06 | evidence |
| Qwen3 8B (Non-reasoning) | Qwen | 0.167824074074074 | 2025-04-28 | evidence |
| Qwen3 8B (Reasoning) | Qwen | 0.225694444444444 | 2025-04-28 | evidence |
| Qwen3 Coder 30B A3B Instruct | Qwen | 0.277777777777778 | 2025-07-31 | evidence |
| Qwen3 Coder 480B A35B Instruct | Qwen | 0.358796296296296 | 2025-07-22 | evidence |
| Qwen3 Coder Next | Qwen | 0.322916666666667 | 2026-02-03 | evidence |
| Qwen3 Max | Qwen | 0.383101851851852 | 2025-09-23 | evidence |
| Qwen3 Max (Preview) | Qwen | 0.37037037037037 | 2025-09-05 | evidence |
| Qwen3 Max Thinking | Qwen | 0.430555555555556 | 2026-01-26 | evidence |
| Qwen3 Max Thinking (Preview) | Qwen | 0.386574074074074 | 2025-11-03 | evidence |
| Qwen3 Next 80B A3B (Reasoning) | Qwen | 0.387731481481481 | 2025-09-11 | evidence |
| Qwen3 Next 80B A3B Instruct | Qwen | 0.306712962962963 | 2025-09-11 | evidence |
| Qwen3 Omni 30B A3B (Reasoning) | Qwen | 0.305555555555556 | 2025-09-22 | evidence |
| Qwen3 Omni 30B A3B Instruct | Qwen | 0.186342592592593 | 2025-09-22 | evidence |
| Qwen3 VL 235B A22B (Reasoning) | Qwen | 0.399305555555556 | 2025-09-23 | evidence |
| Qwen3 VL 235B A22B Instruct | Qwen | 0.358796296296296 | 2025-09-23 | evidence |
| Qwen3 VL 30B A3B (Reasoning) | Qwen | 0.288194444444444 | 2025-10-03 | evidence |
| Qwen3 VL 30B A3B Instruct | Qwen | 0.30787037037037 | 2025-10-03 | evidence |
| Qwen3 VL 32B (Reasoning) | Qwen | 0.284722222222222 | 2025-10-21 | evidence |
| Qwen3 VL 32B Instruct | Qwen | 0.300925925925926 | 2025-10-21 | evidence |
| Qwen3 VL 4B (Reasoning) | Qwen | 0.171296296296296 | 2025-10-14 | evidence |
| Qwen3 VL 4B Instruct | Qwen | 0.136574074074074 | 2025-10-14 | evidence |
| Qwen3 VL 8B (Reasoning) | Qwen | 0.21875 | 2025-10-14 | evidence |
| Qwen3 VL 8B Instruct | Qwen | 0.173611111111111 | 2025-10-14 | evidence |
| Qwen3.5 0.8B (Non-reasoning) | Qwen | 0.0289351851851852 | 2026-03-02 | evidence |
| Qwen3.5 0.8B (Reasoning) | Qwen | 0 | 2026-03-02 | evidence |
| Qwen3.5 122B A10B (Non-reasoning) | Qwen | 0.356481481481482 | 2026-02-24 | evidence |
| Qwen3.5 122B A10B (Reasoning) | Qwen | 0.420138888888889 | 2026-02-24 | evidence |
| Qwen3.5 27B (Non-reasoning) | Qwen | 0.366898148148148 | 2026-02-24 | evidence |
| Qwen3.5 27B (Reasoning) | Qwen | 0.394675925925926 | 2026-02-24 | evidence |
| Qwen3.5 2B (Non-reasoning) | Qwen | 0.0717254663422547 | 2026-03-02 | evidence |
| Qwen3.5 2B (Reasoning) | Qwen | 0.0277777777777778 | 2026-03-02 | evidence |
| Qwen3.5 35B A3B (Non-reasoning) | Qwen | 0.292824074074074 | 2026-02-24 | evidence |
| Qwen3.5 35B A3B (Reasoning) | Qwen | 0.377314814814815 | 2026-02-24 | evidence |
| Qwen3.5 397B A17B (Non-reasoning) | Qwen | 0.41087962962963 | 2026-02-16 | evidence |
| Qwen3.5 397B A17B (Reasoning) | Qwen | 0.420138888888889 | 2026-02-16 | evidence |
| Qwen3.5 4B (Non-reasoning) | Qwen | 0.18287037037037 | 2026-03-02 | evidence |
| Qwen3.5 4B (Reasoning) | Qwen | 0.161011531015357 | 2026-03-02 | evidence |
| Qwen3.5 9B (Non-reasoning) | Qwen | 0.276821658615137 | 2026-03-02 | evidence |
| Qwen3.5 9B (Reasoning) | Qwen | 0.275462962962963 | 2026-03-02 | evidence |
| Qwen3.5 Omni Flash | Qwen | 0.25462962962963 | 2026-03-30 | evidence |
| Qwen3.5 Omni Plus | Qwen | 0.405092592592593 | 2026-03-30 | evidence |
| Qwen3.6 27B (Non-reasoning) | Qwen | 0.372685185185185 | 2026-04-22 | evidence |
| Qwen3.6 27B (Reasoning) | Qwen | 0.398148148148148 | 2026-04-22 | evidence |
| Qwen3.6 35B A3B (Non-reasoning) | Qwen | 0.0127314814814815 | 2026-04-16 | evidence |
| Qwen3.6 35B A3B (Reasoning) | Qwen | 0.357638888888889 | 2026-04-16 | evidence |
| Qwen3.6 Max Preview | Qwen | 0.46875 | 2026-04-20 | evidence |
| Qwen3.6 Plus | Qwen | 0.407407407407407 | 2026-04-02 | evidence |
| Qwen3.7 Max | Qwen | 0.488425925925926 | 2026-05-19 | evidence |
| Qwen3.7 Plus | Qwen | 0.454861111111111 | 2026-06-01 | evidence |
| Qwen3.8 2.4T A95B | Qwen | 0.516203703703704 | 2026-08-12 | evidence |
| Qwen3.8 27B (low) | Qwen | 0.398148148148148 | 2026-08-14 | evidence |
| Qwen3.8 27B (medium) | Qwen | 0.380787037037037 | 2026-08-14 | evidence |
| Qwen3.8 27B (Non-reasoning) | Qwen | 0.356481481481481 | 2026-08-14 | evidence |
| Qwen3.8 27B (xhigh) | Qwen | 0.446759259259259 | 2026-08-14 | evidence |
| Qwen3.8 Max | Qwen | 0.528935185185185 | 2026-08-03 | evidence |
| QwQ 32B | Qwen | 0.357638888888889 | 2025-03-05 | evidence |
| QwQ 32B-Preview | Qwen | 0.0381944444444444 | 2024-11-27 | evidence |
| Reka Flash 3 | Reka AI | 0.267361111111111 | 2025-03-10 | evidence |
| Ring-1T | InclusionAI | 0.366898148148148 | 2025-10-13 | evidence |
| Ring-2.6-1T | InclusionAI | 0.423611111111111 | 2026-05-08 | evidence |
| Ring-flash-2.0 | InclusionAI | 0.167824074074074 | 2025-09-19 | evidence |
| Sarvam 105B (high) | Sarvam | 0.263888888888889 | 2026-03-06 | evidence |
| Sarvam 30B (high) | Sarvam | 0.19212962962963 | 2026-03-06 | evidence |
| Sarvam M (Reasoning) | Sarvam | 0.178240740740741 | 2025-05-23 | evidence |
| Seed-OSS-36B-Instruct | ByteDance Seed | 0.364583333333333 | 2025-08-20 | evidence |
| Solar Open 100B (Reasoning) | Upstage | 0.268518518518519 | 2025-12-17 | evidence |
| Solar Open2 250B | Upstage | 0.456018518518519 | 2026-08-12 | evidence |
| Solar Pro 2 (Non-reasoning) | Upstage | 0.247685185185185 | 2025-07-09 | evidence |
| Solar Pro 2 (Preview) (Non-reasoning) | Upstage | 0.271990740740741 | 2025-05-20 | evidence |
| Solar Pro 2 (Preview) (Reasoning) | Upstage | 0.164351851851852 | 2025-05-20 | evidence |
| Solar Pro 2 (Reasoning) | Upstage | 0.302083333333333 | 2025-07-09 | evidence |
| Solar Pro 3 | Upstage | 0.246527777777778 | 2026-04-06 | evidence |
| Solar Pro 4 | Upstage | 0.436342592592593 | 2026-08-06 | evidence |
| Sonar | Perplexity | 0.229166666666667 | 2025-01-21 | evidence |
| Sonar Pro | Perplexity | 0.225694444444444 | 2025-01-21 | evidence |
| Step 3.5 Flash | StepFun | 0.403747266639333 | 2026-02-02 | evidence |
| Step 3.5 Flash 2603 | StepFun | 0.385416666666667 | 2026-04-02 | evidence |
| Step 3.7 Flash | StepFun | 0.400462962962963 | 2026-05-29 | evidence |
| Step3 VL 10B | StepFun | 0.311342592592593 | 2026-01-20 | evidence |
| Tiny Aya Global | Cohere | 0.0358796296296296 | 2026-02-17 | evidence |
| Tri-21B-Think | Trillion Labs | 0.173611111111111 | 2026-02-10 | evidence |
| Tri-21B-think Preview | Trillion Labs | 0.177833202921231 | 2026-02-10 | evidence |
| Trinity Large Thinking | Arcee AI | 0.361111111111111 | 2026-04-01 | evidence |
Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.