LSTM is dead. Long Live Transformers!
540K views • 6 years ago
Seattle Applied Deep Learning
Leo Dirac explains how transformer models have replaced LSTMs in NLP. He gives background from bag of words through RNNs and LSTMs, then a technical deep dive into multi-headed self-attention and positional encoding, with sample code.
