ml

Andrej Karpathy builds a GPT from scratch in code, following Attention Is All You Need and GPT-2/3, in about two hours using PyTorch. He connects it to ChatGPT and assumes familiarity with his earlier makemore videos.

Jeremy Howard's 90-minute practical tour of language models. It covers how they work, GPT-4's capabilities and limits, using the OpenAI API, code writing, data analysis and fine-tuning.

A three-minute Emacs Rocks screencast by Magnar Sveen demonstrating paredit, which edits Lisp code structurally as a tree of s-expressions rather than characters.

Martin Gorner's Devoxx talk introduces deep learning with TensorFlow, walking through neural networks for MNIST, how to choose an architecture and how to diagnose networks that fail to train.

Phoenix creator Chris McCord builds a real-time Twitter-style app live with Phoenix LiveView 1.5 in about 15 minutes. It shows interactive, real-time updates without writing JavaScript.

A short screencast tour of JSPM, SystemJS and ES6 features, building a small app with the then-new JavaScript module and package tooling. It shows how JSPM works as a package manager, bundler and loader.

David Beazley's PyCon 2019 tutorial derives the lambda calculus from the ground up in Python, using only single-argument functions. He builds booleans, numerals and more with no other language features.

The first episode of Google's Machine Learning Recipes series. It introduces machine learning and builds a first supervised-learning classifier in about six lines of Python using scikit-learn.

John Scholes builds a depth-first tree-search operator step by step in a Dyalog APL session. It covers higher-order functions and runs the search on the N-Queens problem.

The first part of Robert Baruch's series on building a 6800 CPU on an FPGA with nMigen, a Python-based hardware description language. It introduces the HDL while implementing a simpler 6800 core.

The first stream in the Emacs From Scratch series, building a custom Emacs configuration from zero while teaching basics. It covers a usable baseline setup and the packages for completion, themes and productivity.

An episode of FunFunFunction explaining monads in JavaScript as functors that also implement flatMap. It builds on the preceding functor episode and works through code examples.

James Trunk introduces Clojure syntax and thinking, covering its core data structures, immutability, the thread-last macro and live data analysis in the REPL.

The first of a short series by Welch Labs on building a complete neural network in Python. It introduces the data and the architecture of a simple network before later parts cover forward propagation, gradient descent, and backpropagation.

The first episode of a screencast series building djb's redo build system from scratch in Haskell. It explains the purpose of redo, writes initial code and sets up a GitHub repository.

Tsoding live-codes a JSON parser from scratch in Haskell in about 111 lines, using only the standard library. It is an edited Twitch stream that explains the intuition behind parser combinators, functors, applicatives and monads.

Jeri Ellsworth shows step by step how to make an NMOS transistor at home using a kiln, rust remover, spin-on dopant, eBay wafers and vinyl stickers.

Andrej Karpathy builds a bigram character-level language model from scratch, introducing torch.Tensor and the framework of training, sampling and loss evaluation. It is the first step toward a GPT-style Transformer in his makemore series.

In a long live-coding session, Andreas Kling works on making the Cookie Clicker game playable in the Ladybird browser from SerenityOS. He tracks down bugs in the browser engine and fixes them.

A 2018 tutorial explaining uBlock Origin's advanced user mode, including how to block scripts and use the dynamic filtering settings. It positions the extension as a replacement for tools like uMatrix.

Marco Baringer's tutorial video on SLIME, the Emacs mode for developing Common Lisp. It demonstrates the interactive workflow of working against a live Lisp image.

Dan Wahlin's hour-long beginner course on AngularJS builds a small single-page app while covering SPAs, directives, filters and data binding. It gives an initial grounding in Angular 1.

Ben Krasnow of Applied Science uses an antique 4x5 view camera to make high-resolution photolithography masks in a home shop. He photographs a poster-sized printout onto litho film to get features around 20 microns.

A screencast tutorial on Specter, a Clojure library for navigating and transforming nested data structures declaratively, demonstrated in a REPL.

Jeri Ellsworth shows early steps of making microchips at home: cleaving wafers, removing native oxide, testing dopant type with a hot probe, and loading the furnace.