SemVerBench

What is SemVerBench?

A benchmark of LLM version-constraint resolution semantics across npm, PEP 440, and Cargo, with 240 machine-checkable items.

Released

2026-09-10

Evaluates

General AI, Language & Knowledge, cs.AI

Openness

unknown

Importer

Claire Radar

Review status

ai-name-audit-deferred

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2609.11180

SemVerBench paper

• Paper https://arxiv.org/abs/2609.11180

Which sources cite SemVerBench?

• SemVerBench

Related General AI, Language & Knowledge, cs.AI benchmarks

• $\tau^\tau$-Bench: An Environment for End-To-End, Realistic Agent Construction
• 3DCodeBench
• 5-Dialects-BN
• A Large-Scale Dataset and Benchmark
• A3S-Bench
• AARRI-Bench
• ABC-Bench
• ActBench