Benchmark

Cybersecurity CTFs Benchmark

What is Cybersecurity CTFs?

Cybersecurity Capture the Flag (CTF) benchmark for evaluating LLMs in offensive security challenges. Contains diverse cybersecurity tasks including…

Modality
text
Evaluates
safety
Openness
unknown
Importer
LLM Stats
Reported scores
3

Source provenance

Cybersecurity CTFs results and reported scores

LLM Stats

ModelOrganizationReported valueReportedEvidence
Claude Haiku 4.5Anthropic0.468752025-10-15evidence
GPT-5.3 CodexOpenAI0.7762026-02-05evidence
o1-miniOpenAI0.2872024-09-12evidence

Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.

Which sources cite Cybersecurity CTFs?

Related safety benchmarks