Self-Attention
Every token looks at every other token to decide meaning.
Teaching this in the lesson? Read the chapter.
Step 1 of 3
1. Bank example
'bank' means different near river vs money.
- bankmoney sense
- bankriver sense
Prefer prose? Every animation has a matching chapter, listed above. Diagrams use text labels, so they read aloud with the listen button on the lesson page.