RepoProbe Benchmark

What is RepoProbe?

Evaluates repository-level code understanding via 500 open-ended questions derived from GitHub Discussions across 50 repositories, scored with checklist-based…

Released

2026-08-05

Evaluates

Code & Software, Software & AI Compute, cs.SE

Openness

unknown

Importer

Claire Radar

Review status

ai-reviewed

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2608.04783

RepoProbe paper and code

• Paper https://arxiv.org/abs/2608.04783
• Code https://github.com/Tencent-Hunyuan/RepoProbe

Which sources cite RepoProbe?

• RepoProbe

Related Code & Software, Software & AI Compute, cs.SE benchmarks

• Active-SWE
• AFT-Bench
• Agent App Benchmark
• Agent Retrieval Bench
• Agent Systems Benchmark (ASB)
• Agentic Evaluation in 2D Mazes
• Agentic Security Benchmark
• AgentInfraBench