Almanac Benchmark

What is Almanac?

Evaluates agent memory systems on generated multi-month conversation lives, testing time, plans, provenance, absence, tasks, and hygiene via 215 questions.

Released

2026-09-25

Evaluates

Agents, Factuality, General AI, Language & Knowledge

Openness

unknown

Importer

Claire Radar

Review status

ai-reviewed

Reported scores

0

Source provenance

• Original evidence https://github.com/jbpayton/almanac

Almanac code

• Code https://github.com/jbpayton/almanac

Which sources cite Almanac?

• Almanac

Related Agents, Factuality, General AI, Language & Knowledge benchmarks

• $\tau^\tau$-Bench: An Environment for End-To-End, Realistic Agent Construction
• 2d-fet-bench
• 3DCodeBench
• 5-Dialects-BN
• A Large-Scale Dataset and Benchmark
• A Real-World CAD Segmentation Benchmark
• A3S-Bench
• AARRI-Bench