State of GPT | BRK216HFS
785K views • 3 years ago
Microsoft Developer
Andrej Karpathy walks through how GPT assistants are trained, from tokenization and pretraining to supervised finetuning and RLHF, and gives practical prompting strategies and a view of the tooling ecosystem.