silentbug Benchmark

What is silentbug?

Evaluates agents on detecting silent ML training defects across 18 CPU-only PyTorch tasks, scoring patch application, metric recovery, localization…

Released

2026-08-20

Evaluates

Language & Knowledge, Software & AI Compute, cs.AI

Openness

unknown

Importer

Claire Radar

Review status

ai-name-audit-deferred

Reported scores

0

Source provenance

• Original evidence https://github.com/Json604/silentbug-bench

silentbug code

• Code https://github.com/Json604/silentbug-bench

Which sources cite silentbug?

• silentbug

Related Language & Knowledge, Software & AI Compute, cs.AI benchmarks

• 5-Dialects-BN
• A Large-Scale Dataset and Benchmark
• AARRI-Bench
• ABC-Bench
• Active-SWE
• ActiveSciBench
• AdaMem-Bench
• AdvancedMathBench