Benchmark

Brain-to-Text Benchmark '24

What is Brain-to-Text Benchmark '24?

Evaluates 1,200 held-out sentences from one participant (T12). Language model post-processing is part of each system, and results do not establish transfer to…

Released: 2023-06-01
Evaluates: science
Openness: unknown
Importer: Model reports
Reported scores: 4

Source provenance

Original evidence https://eval.ai/web/challenges/challenge-page/2099/overview

Brain-to-Text Benchmark '24 links

Website https://eval.ai/web/challenges/challenge-page/2099/overview

Brain-to-Text Benchmark '24 results and reported scores

Model reports

Model	Organization	Reported value	Reported	Evidence
DCoND-LIFT	Shlizerman Lab	5.81	2024-06-01	evidence
PyTorch baseline	Stanford NPTL	9.76	2024-06-01	evidence
TeamCyber submission	Okubo Lab at CIBR	8.26	2024-06-01	evidence
Tyler Benster et al. submission	Tyler Benster et al.	8.93	2024-06-01	evidence

Scores are partitioned by the source that reported them and are never merged into a single cross-source ranking, because the sources measure different things and say so.

Which sources cite Brain-to-Text Benchmark '24?

Brain-to-Text Benchmark '24 leaderboard Stanford Neural Prosthetics Translational Laboratory