path tracing

Andrej Karpathy builds a bigram character-level language model from scratch, introducing torch.Tensor and the framework of training, sampling and loss evaluation. It is the first step toward a GPT-style Transformer in his makemore series.

Andrej Karpathy builds a GPT from scratch in code, following Attention Is All You Need and GPT-2/3, in about two hours using PyTorch. He connects it to ChatGPT and assumes familiarity with his earlier makemore videos.

Inigo Quilez live-codes the "Happy Jumping" animated scene in a Shadertoy GLSL shader over about six hours. He builds the raymarched character step by step, explaining the math and procedural techniques, with checkpoints linked for each stage.