AgentFairBench
Explore score history ↗AgentFairBench evaluates demographic disparity in the actions of LLM agents across hiring, lending, and medical triage. It uses synthetic, demographic-neutral profiles in counterfactual matched sets varying name-coded race/gender. Metrics include counterfactual flip rate, mean absolute score difference, action-rate disparity, and tool-invocation disparity, with bootstrap confidence intervals and FDR control.
- Released
- 2026-06-15
- Evaluates
- General AI, Language & Knowledge, cs.AI
- Openness
- unknown
- Importer
- Claire Radar
- Review status
- unreviewed
AgentFairBench paper and code
No reported scores are on record for this benchmark yet.