ORCA-bench

What is ORCA-bench?

ORCA-bench evaluates language model agents on root cause analysis in a production-fidelity oncall setting, using a live OpenTelemetry-instrumented microservice…

Released

2026-07-30

Evaluates

Code & Software, Software & AI Compute, cs.CL

Openness

unknown

Importer

Claire Radar

Review status

unreviewed

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2607.28545

ORCA-bench paper

• Paper https://arxiv.org/abs/2607.28545
• Website https://hub.harborframework.com/datasets/orca-bench/orca-bench

Which sources cite ORCA-bench?

• ORCA-bench

Related Code & Software, Software & AI Compute, cs.CL benchmarks

• 5-Dialects-BN
• Active-SWE
• AdaMem-Bench
• AdaPlanBench
• AFT-Bench
• AGC-Bench
• Agent App Benchmark
• Agent Retrieval Bench