led

Andrej Karpathy builds a GPT from scratch in code, following Attention Is All You Need and GPT-2/3, in about two hours using PyTorch. He connects it to ChatGPT and assumes familiarity with his earlier makemore videos.

Andrej Karpathy builds a bigram character-level language model from scratch, introducing torch.Tensor and the framework of training, sampling and loss evaluation. It is the first step toward a GPT-style Transformer in his makemore series.

Ben Krasnow of Applied Science uses an antique 4x5 view camera to make high-resolution photolithography masks in a home shop. He photographs a poster-sized printout onto litho film to get features around 20 microns.

A 12-minute beginner lesson from Nick Milo's Linking Your Thinking series introducing the Obsidian note-taking app and the first steps to start using it.

Blender Guru's beginner tutorial series, in which you model, light, texture and render a donut while learning Blender's core features. This is Part 1 of the Blender 3.0 version.

James Hoffmann demonstrates his AeroPress technique with a short recipe: 11g of coffee, 200g of just-boiled water, a 2-minute immersion, then a press. He explains why he skips rinsing, preheating and inverting.

In this first Crust of Rust episode, Jon Gjengset live-codes an example that needs multiple explicit lifetime annotations. Along the way he covers string types and generics over a custom trait.

Andreas Kling live-codes a prototype JavaScript JIT compiler for the LibJS engine used in SerenityOS and Ladybird. He builds a standalone bytecode VM, a simple interpreter, and then a simple JIT in about 80 minutes.