learning from data

Andrej Karpathy builds a GPT from scratch in code, following Attention Is All You Need and GPT-2/3, in about two hours using PyTorch. He connects it to ChatGPT and assumes familiarity with his earlier makemore videos.

The first stream in the Emacs From Scratch series, building a custom Emacs configuration from zero while teaching basics. It covers a usable baseline setup and the packages for completion, themes and productivity.

NightHawkInLight shows how to make radiative sky cooling paint from grocery and hardware store materials, including a novel calcium carbonate microsphere synthesis. The paint can cool a surface below ambient air temperature in direct sunlight without electricity.

The first lesson of MangoJelly's FreeCAD 0.20 beginner course, covering setup, preferences and navigation. The series teaches fundamentals through complete workflows such as sketching, Part Design and STL export.

A walkthrough of installing Synapse, Riot and Jitsi from scratch on Debian to run your own Matrix communication service. The description warns it is now quite outdated and links to updated material.

Big Clive shows how to pick up discarded disposable vape devices from the roadside and extract the rechargeable lithium cells inside. He explains why these devices contain the same circuitry as rechargeable ones and how to reuse the cells.

Loopop reviews the Polyend Tracker hardware tracker-style sequencer and walks through a tutorial from sampling to finishing a song. It covers most of the device's features.

A reupload of Joel Spolsky's talk teaching spreadsheet users the Excel features they are probably missing, such as keyboard navigation, named ranges, tables and lookups. The original disappeared and this copy comes from the Wayback Machine.

Inigo Quilez live-codes a cartoon character painting entirely from math, using signed distance fields in a Shadertoy shader. He explains each step of building the image from formulas.

Inigo Quilez live-paints a mountain landscape using only math in a shader, building up from a basic polynomial noise surface through fractal terrain, lighting and atmosphere. The code runs in real time on Shadertoy so viewers can edit it as they follow along.

Blender Guru's beginner tutorial series, in which you model, light, texture and render a donut while learning Blender's core features. This is Part 1 of the Blender 3.0 version.

Kenneth Finnegan shows how USB-C Power Delivery trigger boards like the ZY12PDN negotiate 5V to 20V so you can power projects from a USB-C charger, including the color coding for each voltage.

Jeremy Howard's 90-minute practical tour of language models. It covers how they work, GPT-4's capabilities and limits, using the OpenAI API, code writing, data analysis and fine-tuning.

Imphenzia's 83-minute tutorial covers the low poly modeling techniques he learned over five years of Blender use, with timestamps from navigation and extrusion onward. It uses Blender 2.83 with default keys.

Ian Hubert shows quick, unconventional tricks for greenscreen compositing in Blender, as a follow-up to his motion tracking video.

James Trunk introduces Clojure syntax and thinking, covering its core data structures, immutability, the thread-last macro and live data analysis in the REPL.

A 12-minute beginner lesson from Nick Milo's Linking Your Thinking series introducing the Obsidian note-taking app and the first steps to start using it.

Ben Vallack walks through designing a custom keyboard PCB from scratch using Ergogen and KiCad, ending with a gerber file ready to order from a PCB fabricator. The example is a split keyboard.

A 100-minute tutorial from Phil's Lab on designing an STM32-based 'black pill' PCB in KiCad 6. It covers schematic capture, two-layer layout and routing, USB, and sending the board for manufacture and assembly.

The first part of a series on programming in Jai, Jonathan Blow's in-development language. It covers compiling, writing hello world and using code from other files.

Andrej Karpathy builds a bigram character-level language model from scratch, introducing torch.Tensor and the framework of training, sampling and loss evaluation. It is the first step toward a GPT-style Transformer in his makemore series.

Markus Triska tours Prolog's most distinctive features, including its use as a database and query language, rule processing, constraint solving and compile-time rewriting. It also covers concise meta-interpreters.

In a long live-coding session, Andreas Kling works on making the Cookie Clicker game playable in the Ladybird browser from SerenityOS. He tracks down bugs in the browser engine and fixes them.

A guided Wim Hof breathing session of three rounds at a slow pace, building from a 30 second to a 90 second breath hold. An on-screen bubble animation helps you keep the rhythm.

Jon Gjengset's long live-coding Crust of Rust episode on async/await, focused on the mental model for using it rather than on Futures, Pin and Wakers internals. Topics include awaiting multiple futures, cancellation, executors and select.

Everyday Astronaut's guide to visiting Starbase, Texas to see Starship, covering what and where it is, which areas close during launches, where to watch from, where to fly into and stay, and things to do.

Jon Gjengset's roughly four-hour live stream implementing part of a BitTorrent client in Rust, following CodeCrafters' test-guided challenge. He builds from scratch and shows idiomatic error handling along the way.