ml

Andrej Karpathy builds a GPT from scratch in code, following Attention Is All You Need and GPT-2/3, in about two hours using PyTorch. He connects it to ChatGPT and assumes familiarity with his earlier makemore videos.

Jeremy Howard's 90-minute practical tour of language models. It covers how they work, GPT-4's capabilities and limits, using the OpenAI API, code writing, data analysis and fine-tuning.

Phoenix creator Chris McCord builds a real-time Twitter-style app live with Phoenix LiveView 1.5 in about 15 minutes. It shows interactive, real-time updates without writing JavaScript.

The first stream in the Emacs From Scratch series, building a custom Emacs configuration from zero while teaching basics. It covers a usable baseline setup and the packages for completion, themes and productivity.

James Trunk introduces Clojure syntax and thinking, covering its core data structures, immutability, the thread-last macro and live data analysis in the REPL.

Andrej Karpathy builds a bigram character-level language model from scratch, introducing torch.Tensor and the framework of training, sampling and loss evaluation. It is the first step toward a GPT-style Transformer in his makemore series.

In a long live-coding session, Andreas Kling works on making the Cookie Clicker game playable in the Ladybird browser from SerenityOS. He tracks down bugs in the browser engine and fixes them.

Ben Krasnow of Applied Science uses an antique 4x5 view camera to make high-resolution photolithography masks in a home shop. He photographs a poster-sized printout onto litho film to get features around 20 microns.