QuechuaTok Benchmark

What is QuechuaTok?

A comparison of tokenization strategies (BPE, Unigram LM, WordPiece, PRPE) for Southern Quechua using a 200k-sentence corpus and a finite-state morphological…

Released

2026-06-22

Evaluates

Language & Knowledge, Software & AI Compute, cs.CL

Openness

unknown

Importer

Claire Radar

Review status

unreviewed

Reported scores

0

Source provenance

• Original evidence https://arxiv.org/abs/2606.23943

QuechuaTok paper

• Paper https://arxiv.org/abs/2606.23943

Which sources cite QuechuaTok?

• QuechuaTok

Related Language & Knowledge, Software & AI Compute, cs.CL benchmarks

• 5-Dialects-BN
• A Large-Scale Dataset and Benchmark
• AARRI-Bench
• ABC-Bench
• Active-SWE
• ActiveSciBench
• AdaMem-Bench
• AdaPlanBench