Type Alias Tokenizer

Common tokenizers used for text processing.

These values represent standard tokenization approaches and popular pre-trained tokenizers from the Hugging Face ecosystem.