ai progress

Jon Gjengset's long live-coding Crust of Rust episode on async/await, focused on the mental model for using it rather than on Futures, Pin and Wakers internals. Topics include awaiting multiple futures, cancellation, executors and select.

Jeremy Howard's 90-minute practical tour of language models. It covers how they work, GPT-4's capabilities and limits, using the OpenAI API, code writing, data analysis and fine-tuning.

Jon Gjengset's long live-coding stream explains Rust's Pin and Unpin types: why they exist, how they work, and how they connect to futures and async/await. It also covers moving from pre-pinning code to the new model.

A long Tsoding Daily programming stream in which he implements hot code reloading in C by loading a dynamic library at runtime without stopping the main program. It also touches on migrating struct versions across reloads.

Martin Gorner's Devoxx talk introduces deep learning with TensorFlow, walking through neural networks for MNIST, how to choose an architecture and how to diagnose networks that fail to train.

In this first Crust of Rust episode, Jon Gjengset live-codes an example that needs multiple explicit lifetime annotations. Along the way he covers string types and generics over a custom trait.

Andrej Karpathy builds a GPT from scratch in code, following Attention Is All You Need and GPT-2/3, in about two hours using PyTorch. He connects it to ChatGPT and assumes familiarity with his earlier makemore videos.

Chess player John Bartholomew plays opponents rated below 1000 on Chess.com and comments on optimal strategy and typical mistakes at that level. It is part of his Climbing the Rating Ladder series.

Day 1 of Handmade Hero's introduction to C on Windows, covering setting up Visual Studio, creating a Win32 project, the WinMain entry point and writing a first function. It is the starting point for Casey Muratori's from-scratch game series.

Day 1 of Casey Muratori's Handmade Hero, a live-coded game built from scratch in C on Windows. It reviews C on Windows, sets up a minimal build system and WinMain entry point, and shows a first MessageBox.

Tsoding live-codes a JSON parser from scratch in Haskell in about 111 lines, using only the standard library. It is an edited Twitch stream that explains the intuition behind parser combinators, functors, applicatives and monads.

Andrej Karpathy builds a bigram character-level language model from scratch, introducing torch.Tensor and the framework of training, sampling and loss evaluation. It is the first step toward a GPT-style Transformer in his makemore series.

Inigo Quilez live-codes the "Happy Jumping" animated scene in a Shadertoy GLSL shader over about six hours. He builds the raymarched character step by step, explaining the math and procedural techniques, with checkpoints linked for each stage.

Dave Jones builds the Evil Mad Scientist discrete-component 555 timer kit, then tests it and explains the internal circuitry of the 555 at transistor level. He finishes with scope waveforms.

A two-hour NANOG tutorial by Richard Steenbergen aimed at network engineers, covering optical networking technologies. This is the updated 2017 edition of a recurring talk.

Day 21 of Casey Muratori's Handmade Hero, which covers loading game code dynamically from a DLL on Windows. He builds hot reloading of C game code from scratch in about an hour and a half.