d language

Andrej Karpathy builds a bigram character-level language model from scratch, introducing torch.Tensor and the framework of training, sampling and loss evaluation. It is the first step toward a GPT-style Transformer in his makemore series.

David Sanders gives the first part of a two-part introduction to the Julia programming language at SciPy 2014. It walks through the language's basics and its appeal for scientific computing.

Jeremy Howard's 90-minute practical tour of language models. It covers how they work, GPT-4's capabilities and limits, using the OpenAI API, code writing, data analysis and fine-tuning.

The first part of a series on programming in Jai, Jonathan Blow's in-development language. It covers compiling, writing hello world and using code from other files.

Day 1 of Handmade Hero's introduction to C on Windows, covering setting up Visual Studio, creating a Win32 project, the WinMain entry point and writing a first function. It is the starting point for Casey Muratori's from-scratch game series.

David Beazley's PyCon 2019 tutorial derives the lambda calculus from the ground up in Python, using only single-argument functions. He builds booleans, numerals and more with no other language features.

Markus Triska tours Prolog's most distinctive features, including its use as a database and query language, rule processing, constraint solving and compile-time rewriting. It also covers concise meta-interpreters.

Andrej Karpathy builds a GPT from scratch in code, following Attention Is All You Need and GPT-2/3, in about two hours using PyTorch. He connects it to ChatGPT and assumes familiarity with his earlier makemore videos.

Bisqwit builds a Doom or Duke Nukem 3D style software-rendered 3D engine in C from scratch, supporting non-Euclidean geometry. It covers vector rotation and portal rendering with sped-up, tool-assisted coding.

Bisqwit writes a NES emulator in C++ in about 15 minutes of tool-assisted, sped-up coding, narrated with captions. It shows an accurate emulator built with a compile-time generated 6502 instruction table. Part 2 covers compiling and running it.

The first episode of Google's Machine Learning Recipes series. It introduces machine learning and builds a first supervised-learning classifier in about six lines of Python using scikit-learn.

A three-hour PyCon 2016 tutorial by Christophe Pettus that orients Python developers to PostgreSQL. It covers installation, administration, and use, including vacuuming, MVCC, replication and backups.

Jon Gjengset's long live-coding stream explains Rust's Pin and Unpin types: why they exist, how they work, and how they connect to futures and async/await. It also covers moving from pre-pinning code to the new model.

Day 1 of Casey Muratori's Handmade Hero, a live-coded game built from scratch in C on Windows. It reviews C on Windows, sets up a minimal build system and WinMain entry point, and shows a first MessageBox.

David Beazley's workshop screencast builds asynchronous programming in Python from scratch, starting from callbacks and continuations and replacing threads to show how concurrency works underneath.

In this first Crust of Rust episode, Jon Gjengset live-codes an example that needs multiple explicit lifetime annotations. Along the way he covers string types and generics over a custom trait.

Bisqwit writes a raytracer from scratch in C++ for DOS, rendering in the 16-color VGA palette at 640x480. The video also covers color quantization and ordered dithering.

British Museum curator Irving Finkel teaches how to write cuneiform, with a colleague following along. It is a short, lively introduction to the script.

Jon Gjengset's long live-coding Crust of Rust episode on async/await, focused on the mental model for using it rather than on Futures, Pin and Wakers internals. Topics include awaiting multiple futures, cancellation, executors and select.

Day 21 of Casey Muratori's Handmade Hero, which covers loading game code dynamically from a DLL on Windows. He builds hot reloading of C game code from scratch in about an hour and a half.

Jon Gjengset's roughly four-hour live stream implementing part of a BitTorrent client in Rust, following CodeCrafters' test-guided challenge. He builds from scratch and shows idiomatic error handling along the way.

A long Tsoding Daily programming stream in which he implements hot code reloading in C by loading a dynamic library at runtime without stopping the main program. It also touches on migrating struct versions across reloads.

Ben Eater writes a program in a made-up machine language and walks through the control logic an 8-bit breadboard CPU needs to execute it. It is part of his build-an-8-bit-computer series.

Martin Gorner's Devoxx talk introduces deep learning with TensorFlow, walking through neural networks for MNIST, how to choose an architecture and how to diagnose networks that fail to train.

Tsoding live-codes a JSON parser from scratch in Haskell in about 111 lines, using only the standard library. It is an edited Twitch stream that explains the intuition behind parser combinators, functors, applicatives and monads.

A long livestream of George Hotz live-coding a toy SLAM implementation, twitchslam, over two days in May 2018. It is an unedited session of Python programming with computer vision and visualization.

In a long live-coding session, Andreas Kling works on making the Cookie Clicker game playable in the Ladybird browser from SerenityOS. He tracks down bugs in the browser engine and fixes them.

Andreas Kling live-codes a prototype JavaScript JIT compiler for the LibJS engine used in SerenityOS and Ladybird. He builds a standalone bytecode VM, a simple interpreter, and then a simple JIT in about 80 minutes.

A step-by-step tutorial on making a Harry Potter by Balenciaga style AI video, using tools such as ChatGPT, Midjourney and Eleven Labs for script, images and voices.

A 1930s Chevrolet training film explaining the principles and development of the differential gear. It builds the idea step by step from first principles to the finished mechanism.

The first part of Robert Baruch's series on building a 6800 CPU on an FPGA with nMigen, a Python-based hardware description language. It introduces the HDL while implementing a simpler 6800 core.

Harry Schwartz gives a roughly hour-long tour of Emacs Org mode as an outliner, task manager, markup language and agenda tool. He demonstrates how he uses it for documents, presentations and todo lists.