Attention in transformers, step-by-step | Deep Learning Chapter 6
4.8M views • 2 years ago
3Blue1Brown
3Blue1Brown's visual walkthrough of the attention mechanism inside transformers, covering self-attention, multiple heads and cross-attention. It is chapter 6 of his deep learning series.