Tokenizer visualizer

A playground for seeing exactly where the tokenizer draws its boundaries. Type below and your text is re-rendered with every token color-coded inline — hover any token to see its ID. Great for spotting why a word costs more tokens than you'd expect.

Tokenized
Hover a token to see its ID.

Colors mark token boundaries (alternating, so adjacent tokens are distinguishable). OpenAI counts are exact (o200k_base); other providers are estimates via the GPT tokenizer.

More free token tools