Benchmark

CyBench

What is CyBench?

CyBench is a suite of Capture-the-Flag (CTF) challenges measuring agentic cyber attack capabilities. It evaluates dual-use cybersecurity knowledge and measures…

Released
2024-08-15
Modality
text
Evaluates
safety, agents, code
Openness
unknown
Importer
LLM Stats
Reported scores
2

Source provenance

CyBench results and reported scores

LLM Stats

ModelOrganizationReported valueReportedEvidence
Claude Mythos PreviewAnthropic1.02026-04-07evidence
Grok-4.1 ThinkingxAI0.392025-11-17evidence

Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.

Which sources cite CyBench?

Related safety, agents, code benchmarks