Chess move tokenizer explorer
This tokenizer's vocabulary is closed-form and fixed at 1,973 tokens
— every theoretically possible UCI move plus five special tokens
— computed once from chess's own rules, not learned from a corpus.
Unlike a subword tokenizer, it has no fallback: type anything that isn't
a real move (try aaaa) and it genuinely won't encode.
vocab size: —
0 tokens
special token
valid move
not
in vocab