Benchmark

ProfBench

What is ProfBench?

ProfBench evaluates models on professional-domain reasoning and knowledge-work tasks, including search-augmented question answering across expert fields.

Modality
text
Evaluates
reasoning, knowledge, agents
Openness
unknown
Importer
LLM Stats
Reported scores
1

Source provenance

ProfBench results and reported scores

LLM Stats

ModelOrganizationReported valueReportedEvidence
Nemotron 3 Ultra (550B A55B)NVIDIA0.562026-06-04evidence

Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.

Which sources cite ProfBench?

Related reasoning, knowledge, agents benchmarks