PRAGMA Benchmark

What is PRAGMA?

Evaluates personalized guidance through long-term conversation histories and evidence annotations, testing retrieval accuracy and memory-grounded reasoning.

Released

2026-09-09

Evaluates

General AI, Language & Knowledge, Safety

Openness

unknown

Importer

Claire Radar

Review status

ai-reviewed

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2609.09664

PRAGMA paper

• Paper https://arxiv.org/abs/2609.09664

Which sources cite PRAGMA?

• PRAGMA

Related General AI, Language & Knowledge, Safety benchmarks

• $\tau^\tau$-Bench: An Environment for End-To-End, Realistic Agent Construction
• 3DCodeBench
• 5-Dialects-BN
• A Large-Scale Dataset and Benchmark
• A3S-Bench
• AARRI-Bench
• ABC-Bench
• ActBench