Token

The unit a model actually reads and writes: a chunk of characters, usually a word piece. 'Understanding' is one token; 'understanding the tokenizer' is four or five. Rough English rule of thumb: one token is about four characters or three quarters of a word.