GitGoodBench

What is GitGoodBench?

GitGoodBench Lite is a subset of 900 samples for evaluating the performance of AI agents in resolving git tasks (see Supported Scenarios).

Released

2025-05-28

Evaluates

代码, Code, 智能体, Agent, 任务执行, Task Execution, 代码工程, 不支持, Unsupported

Openness

open

Importer

OpenCompass Hub

Reported scores

0

Source provenance

• Original evidence https://hub.opencompass.org.cn/dataset-detail/GitGoodBench

GitGoodBench paper, code and dataset

• Paper https://arxiv.org/pdf/2505.22583
• Code https://github.com/JetBrains-Research/git-good-bench
• Dataset https://huggingface.co/datasets/JetBrains/git_good_bench

Which sources cite GitGoodBench?

• GitGoodBench

Related 代码, Code, 智能体, Agent, 任务执行, Task Execution, 代码工程, 不支持, Unsupported benchmarks

• A-Bench
• A-OKVQA
• AbsPyramid
• ActionAtlas
• Ada-LEval
• AECBench
• AFQMC
• AgentBoard