Beyond Fluency: A Rubric-Based Benchmark for Evaluating Saudi Dialect and Cultural Competence in Large Language Models

What is Beyond Fluency: A Rubric-Based Benchmark for Evaluating Saudi Dialect and Cultural Competence in Large Language Models?

Evaluates large language models on 31 expert-authored prompts covering Saudi dialect phenomena, with expert-established ground truths and rubric-based scoring.

Released

2026-08-30

Evaluates

General AI, Language & Knowledge, cs.CL

Openness

unknown

Importer

Claire Radar

Review status

ai-name-audit-deferred

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2608.29990

Beyond Fluency: A Rubric-Based Benchmark for Evaluating Saudi Dialect and Cultural Competence in Large Language Models paper

• Paper https://arxiv.org/abs/2608.29990

Which sources cite Beyond Fluency: A Rubric-Based Benchmark for Evaluating Saudi Dialect and Cultural Competence in Large Language Models?

• Beyond Fluency: A Rubric-Based Benchmark for Evaluating Saudi Dialect and Cultural Competence in Large Language Models

Related General AI, Language & Knowledge, cs.CL benchmarks

• $\tau^\tau$-Bench: An Environment for End-To-End, Realistic Agent Construction
• 3DCodeBench
• 5-Dialects-BN
• A Large-Scale Dataset and Benchmark
• A3S-Bench
• AARRI-Bench
• ABC-Bench
• ActBench