BabelJudge Benchmark

What is BabelJudge?

BabelJudge audits LLM-as-a-judge reliability across languages and agent trajectories, measuring position bias, verbosity bias, order inconsistency, and…

Released

2026-06-21

Evaluates

Agents, General AI, Safety & Trustworthiness

Openness

unknown

Importer

Claire Radar

Review status

unreviewed

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2606.22329

BabelJudge paper and code

• Paper https://arxiv.org/abs/2606.22329
• Code https://github.com/Shreyaskc/BabelJudge

Which sources cite BabelJudge?

• BabelJudge

Related Agents, General AI, Safety & Trustworthiness benchmarks

• $\tau^\tau$-Bench: An Environment for End-To-End, Realistic Agent Construction
• 3DCodeBench
• 5-Dialects-BN
• A3S-Bench
• AARRI-Bench
• ActBench
• ActiveSciBench
• ActiveVision