CHIARO Benchmark

What is CHIARO?

Human-annotated benchmark of 1,000 sentences where each scene elicits opposing emotions in two agents, evaluated via macro-F1 for both LLMs and classifiers.

Released

2026-09-03

Evaluates

General AI, Language & Knowledge, cs.CL

Openness

unknown

Importer

Claire Radar

Review status

ai-reviewed

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2609.03394

CHIARO paper and code

• Paper https://arxiv.org/abs/2609.03394
• Code https://github.com/cincynlp/Chiaro

Which sources cite CHIARO?

• CHIARO

Related General AI, Language & Knowledge, cs.CL benchmarks

• $\tau^\tau$-Bench: An Environment for End-To-End, Realistic Agent Construction
• 3DCodeBench
• 5-Dialects-BN
• A Large-Scale Dataset and Benchmark
• A3S-Bench
• AARRI-Bench
• ABC-Bench
• ActBench