https://benchmark-radar.org/blog/ One page per collection day: what new benchmarks and evaluations appeared, how strong the evidence was, and which claims the record does not support. en Thu, 03 Sep 2026 00:00:00 GMT https://benchmark-radar.org/blog/2026-09-03/ https://benchmark-radar.org/blog/2026-09-03/ Thu, 03 Sep 2026 00:00:00 GMT Among today’s captured releases, EarlyEval introduces early outcome prediction: it estimates an agent’s final result from intermediate behavior and stops… https://benchmark-radar.org/blog/2026-09-02/ https://benchmark-radar.org/blog/2026-09-02/ Wed, 02 Sep 2026 00:00:00 GMT The newly released InSight benchmark tests agents that must actively interact with visualizations to verify 21,349 claims, rather than answer once from a… https://benchmark-radar.org/blog/2026-09-01/ https://benchmark-radar.org/blog/2026-09-01/ Tue, 01 Sep 2026 00:00:00 GMT EleutherAI released Language Model Evaluation Harness v0.4.13 with fixes that can change prior scores: test questions could leak into their own few-shot… https://benchmark-radar.org/blog/2026-08-31/ https://benchmark-radar.org/blog/2026-08-31/ Mon, 31 Aug 2026 00:00:00 GMT PCFBench reflects a recurring push in this captured feed to inspect an agent’s process rather than only its final answer. It separately tests… https://benchmark-radar.org/blog/2026-08-30/ https://benchmark-radar.org/blog/2026-08-30/ Sun, 30 Aug 2026 00:00:00 GMT The new INSIDER LLM Detection Benchmark evaluates models that may take harmful actions by comparing the model’s self-reported action log with an… https://benchmark-radar.org/blog/2026-08-29/ https://benchmark-radar.org/blog/2026-08-29/ Sat, 29 Aug 2026 00:00:00 GMT The new NBPO benchmark-generations dataset publishes every decoded model response used in three judge-based comparisons, allowing another evaluator to… https://benchmark-radar.org/blog/2026-08-28/ https://benchmark-radar.org/blog/2026-08-28/ Fri, 28 Aug 2026 00:00:00 GMT The new Same Model, Different Harness study holds the coding model and tasks fixed while changing how the agent harness manages conversation history and… https://benchmark-radar.org/blog/2026-08-27/ https://benchmark-radar.org/blog/2026-08-27/ Thu, 27 Aug 2026 00:00:00 GMT OpenCompass v0.5.4 is a substantive harness update, adding native VLMEvalKit-based multimodal evaluation, multi-round inference with the Multi-IF… https://benchmark-radar.org/blog/2026-08-26/ https://benchmark-radar.org/blog/2026-08-26/ Wed, 26 Aug 2026 00:00:00 GMT Across this captured feed, three new agent benchmarks make the evaluated unit an interactive model-plus-runtime system rather than a final answer… https://benchmark-radar.org/blog/2026-08-25/ https://benchmark-radar.org/blog/2026-08-25/ Tue, 25 Aug 2026 00:00:00 GMT New release SUSVIBES evaluates 12 coding-agent settings on 186 real-world feature requests for which human developers previously committed vulnerable… https://benchmark-radar.org/blog/2026-08-24/ https://benchmark-radar.org/blog/2026-08-24/ Mon, 24 Aug 2026 00:00:00 GMT No material GPT insight: No category moved far enough, persistently enough, or across enough independent sources to support a decision-useful finding in… https://benchmark-radar.org/blog/2026-08-23/ https://benchmark-radar.org/blog/2026-08-23/ Sun, 23 Aug 2026 00:00:00 GMT No material GPT insight: No category moved far enough, persistently enough, or across enough independent sources to support a material finding in today’s… https://benchmark-radar.org/blog/2026-08-22/ https://benchmark-radar.org/blog/2026-08-22/ Sat, 22 Aug 2026 00:00:00 GMT No material GPT insight: No material pattern was supported: the captured items did not show a sufficiently large, persistent, cross-source shift. Only 19… https://benchmark-radar.org/blog/2026-08-21/ https://benchmark-radar.org/blog/2026-08-21/ Fri, 21 Aug 2026 00:00:00 GMT No material GPT insight: No material pattern cleared the feed’s persistence and cross-source thresholds today. Only 65 of 198 corpus evidence records were… https://benchmark-radar.org/blog/2026-08-20/ https://benchmark-radar.org/blog/2026-08-20/ Thu, 20 Aug 2026 00:00:00 GMT No material GPT insight: No category changed far enough, persistently enough, and across enough sources to support a decision-useful pattern in this… https://benchmark-radar.org/blog/2026-08-19/ https://benchmark-radar.org/blog/2026-08-19/ Wed, 19 Aug 2026 00:00:00 GMT No material GPT insight: No category changed far enough, persistently enough, or across enough sources to support a material finding in this captured… https://benchmark-radar.org/blog/2026-08-18/ https://benchmark-radar.org/blog/2026-08-18/ Tue, 18 Aug 2026 00:00:00 GMT No material GPT insight: No category change was sufficiently large, persistent, and cross-source to support a material finding. Tracked metric movement… https://benchmark-radar.org/blog/2026-08-17/ https://benchmark-radar.org/blog/2026-08-17/ Mon, 17 Aug 2026 00:00:00 GMT Several new releases in the captured feed redesign evaluation around conditions hidden by static averages: evolving evidence and temporal cutoffs… https://benchmark-radar.org/blog/2026-08-16/ https://benchmark-radar.org/blog/2026-08-16/ Sun, 16 Aug 2026 00:00:00 GMT Agent benchmarking in the captured evidence is being designed around controlled execution, not just task sets: a new arena adds side-by-side and blind… https://benchmark-radar.org/blog/2026-08-15/ https://benchmark-radar.org/blog/2026-08-15/ Sat, 15 Aug 2026 00:00:00 GMT In today’s captured feed, three independent new releases evaluate agents as operational systems: LCAB preserves complete repair sessions and hardware… https://benchmark-radar.org/blog/2026-08-14/ https://benchmark-radar.org/blog/2026-08-14/ Fri, 14 Aug 2026 00:00:00 GMT Two new paper releases in this captured feed question whether aggregate agent scores measure deployable capability: one reports task interactions… https://benchmark-radar.org/blog/2026-08-13/ https://benchmark-radar.org/blog/2026-08-13/ Thu, 13 Aug 2026 00:00:00 GMT Across today’s captured new releases, several benchmarks require inspectable process evidence rather than scoring only final outcomes: replayable… https://benchmark-radar.org/blog/2026-08-12/ https://benchmark-radar.org/blog/2026-08-12/ Wed, 12 Aug 2026 00:00:00 GMT Several new releases in this captured feed bind benchmarks to deployment context: web-access APIs are compared across quality, latency, cost, and error… https://benchmark-radar.org/blog/2026-08-11/ https://benchmark-radar.org/blog/2026-08-11/ Tue, 11 Aug 2026 00:00:00 GMT Multiple new releases in the captured feed move agent evaluation beyond final-task success toward inspecting collaboration graphs, requirement recovery… https://benchmark-radar.org/blog/2026-08-10/ https://benchmark-radar.org/blog/2026-08-10/ Mon, 10 Aug 2026 00:00:00 GMT Several new releases in this captured feed evaluate whether a system reached an answer through valid evidence or execution, not merely whether the answer… https://benchmark-radar.org/blog/2026-08-08/ https://benchmark-radar.org/blog/2026-08-08/ Sat, 08 Aug 2026 00:00:00 GMT Across this feed’s new releases, benchmark design is moving toward specialized, structurally difficult tasks: open-ended scientific extraction… https://benchmark-radar.org/blog/2026-08-07/ https://benchmark-radar.org/blog/2026-08-07/ Fri, 07 Aug 2026 00:00:00 GMT Four newly released agent benchmarks in this captured feed expand evaluation beyond terminal task success: acquisition-stage privacy, learning across… https://benchmark-radar.org/blog/2026-08-06/ https://benchmark-radar.org/blog/2026-08-06/ Thu, 06 Aug 2026 00:00:00 GMT Across this captured feed, four newly released benchmarks evaluate behavior beyond a static, well-specified task: proactive bug discovery without issue… https://benchmark-radar.org/blog/2026-08-05/ https://benchmark-radar.org/blog/2026-08-05/ Wed, 05 Aug 2026 00:00:00 GMT Agentic artifacts rose to 26.3% of our captured feed over the last 5 days, against a 13.6% baseline across the prior 4 days (+12.7 percentage points). https://benchmark-radar.org/blog/2026-08-04/ https://benchmark-radar.org/blog/2026-08-04/ Tue, 04 Aug 2026 00:00:00 GMT Benchmark Radar collected 212 evidence observations from 3 sources on 2026-08-04. https://benchmark-radar.org/blog/2026-08-03/ https://benchmark-radar.org/blog/2026-08-03/ Mon, 03 Aug 2026 00:00:00 GMT Benchmark Radar collected 152 evidence observations from 3 sources on 2026-08-03. https://benchmark-radar.org/blog/2026-08-02/ https://benchmark-radar.org/blog/2026-08-02/ Sun, 02 Aug 2026 00:00:00 GMT Benchmark Radar collected 89 evidence observations from 2 sources on 2026-08-02. https://benchmark-radar.org/blog/2026-08-01/ https://benchmark-radar.org/blog/2026-08-01/ Sat, 01 Aug 2026 00:00:00 GMT Benchmark Radar collected 69 evidence observations from 2 sources on 2026-08-01. https://benchmark-radar.org/blog/2026-07-31/ https://benchmark-radar.org/blog/2026-07-31/ Fri, 31 Jul 2026 00:00:00 GMT Benchmark Radar collected 60 evidence observations from 2 sources on 2026-07-31. https://benchmark-radar.org/blog/2026-07-30/ https://benchmark-radar.org/blog/2026-07-30/ Thu, 30 Jul 2026 00:00:00 GMT Benchmark Radar collected 200 evidence observations from 3 sources on 2026-07-30. https://benchmark-radar.org/blog/2026-07-29/ https://benchmark-radar.org/blog/2026-07-29/ Wed, 29 Jul 2026 00:00:00 GMT Benchmark Radar collected 201 evidence observations from 3 sources on 2026-07-29. https://benchmark-radar.org/blog/2026-07-28/ https://benchmark-radar.org/blog/2026-07-28/ Tue, 28 Jul 2026 00:00:00 GMT Benchmark Radar collected 186 evidence observations from 3 sources on 2026-07-28. https://benchmark-radar.org/blog/2026-07-27/ https://benchmark-radar.org/blog/2026-07-27/ Mon, 27 Jul 2026 00:00:00 GMT Benchmark Radar collected 30 evidence observations from 2 sources on 2026-07-27. https://benchmark-radar.org/blog/2026-07-26/ https://benchmark-radar.org/blog/2026-07-26/ Sun, 26 Jul 2026 00:00:00 GMT Benchmark Radar collected 30 evidence observations from 1 sources on 2026-07-26. https://benchmark-radar.org/blog/2026-07-25/ https://benchmark-radar.org/blog/2026-07-25/ Sat, 25 Jul 2026 00:00:00 GMT Benchmark Radar collected 32 evidence observations from 1 sources on 2026-07-25. https://benchmark-radar.org/blog/2026-07-24/ https://benchmark-radar.org/blog/2026-07-24/ Fri, 24 Jul 2026 00:00:00 GMT Benchmark Radar collected 32 evidence observations from 1 sources on 2026-07-24. https://benchmark-radar.org/blog/2026-07-23/ https://benchmark-radar.org/blog/2026-07-23/ Thu, 23 Jul 2026 00:00:00 GMT Benchmark Radar collected 20 evidence observations from 1 sources on 2026-07-23.