The spelled-out intro to language modeling: building makemore
1.3M views • 4 years ago
Andrej Karpathy
Andrej Karpathy builds a bigram character-level language model from scratch, introducing torch.Tensor and the framework of training, sampling and loss evaluation. It is the first step toward a GPT-style Transformer in his makemore series.
