Tokenization
Text → token IDs. Costs and limits are in tokens.
Teaching this in the lesson? Read the chapter.
Step 1 of 4
1. Raw text
'ChatGPT is great!' is three words to you and something else entirely to a model.
- ChatGPT is great!3 words to you
Prefer prose? Every animation has a matching chapter, listed above. Diagrams use text labels, so they read aloud with the listen button on the lesson page.