ml

Andrej Karpathy builds a GPT from scratch in code, following Attention Is All You Need and GPT-2/3, in about two hours using PyTorch. He connects it to ChatGPT and assumes familiarity with his earlier makemore videos.

A three-minute Emacs Rocks screencast by Magnar Sveen demonstrating paredit, which edits Lisp code structurally as a tree of s-expressions rather than characters.

David Beazley's PyCon 2019 tutorial derives the lambda calculus from the ground up in Python, using only single-argument functions. He builds booleans, numerals and more with no other language features.

John Scholes builds a depth-first tree-search operator step by step in a Dyalog APL session. It covers higher-order functions and runs the search on the N-Queens problem.

An episode of FunFunFunction explaining monads in JavaScript as functors that also implement flatMap. It builds on the preceding functor episode and works through code examples.

James Trunk introduces Clojure syntax and thinking, covering its core data structures, immutability, the thread-last macro and live data analysis in the REPL.

The first of a short series by Welch Labs on building a complete neural network in Python. It introduces the data and the architecture of a simple network before later parts cover forward propagation, gradient descent, and backpropagation.

The first episode of a screencast series building djb's redo build system from scratch in Haskell. It explains the purpose of redo, writes initial code and sets up a GitHub repository.

Tsoding live-codes a JSON parser from scratch in Haskell in about 111 lines, using only the standard library. It is an edited Twitch stream that explains the intuition behind parser combinators, functors, applicatives and monads.

Jeri Ellsworth shows step by step how to make an NMOS transistor at home using a kiln, rust remover, spin-on dopant, eBay wafers and vinyl stickers.

Andrej Karpathy builds a bigram character-level language model from scratch, introducing torch.Tensor and the framework of training, sampling and loss evaluation. It is the first step toward a GPT-style Transformer in his makemore series.

In a long live-coding session, Andreas Kling works on making the Cookie Clicker game playable in the Ladybird browser from SerenityOS. He tracks down bugs in the browser engine and fixes them.

Marco Baringer's tutorial video on SLIME, the Emacs mode for developing Common Lisp. It demonstrates the interactive workflow of working against a live Lisp image.

Ben Krasnow of Applied Science uses an antique 4x5 view camera to make high-resolution photolithography masks in a home shop. He photographs a poster-sized printout onto litho film to get features around 20 microns.

Jeri Ellsworth shows early steps of making microchips at home: cleaving wafers, removing native oxide, testing dopant type with a hot probe, and loading the furnace.