mach-e

Andrej Karpathy builds a GPT from scratch in code, following Attention Is All You Need and GPT-2/3, in about two hours using PyTorch. He connects it to ChatGPT and assumes familiarity with his earlier makemore videos.

Jeremy Howard's 90-minute practical tour of language models. It covers how they work, GPT-4's capabilities and limits, using the OpenAI API, code writing, data analysis and fine-tuning.

Andrej Karpathy builds a bigram character-level language model from scratch, introducing torch.Tensor and the framework of training, sampling and loss evaluation. It is the first step toward a GPT-style Transformer in his makemore series.

Mitchell Hashimoto walks through his setup for running a NixOS virtual machine on a Mac as his development environment, with a config repo on GitHub.

Inigo Quilez live-paints a mountain landscape using only math in a shader, building up from a basic polynomial noise surface through fractal terrain, lighting and atmosphere. The code runs in real time on Shadertoy so viewers can edit it as they follow along.

The first lesson of MangoJelly's FreeCAD 0.20 beginner course, covering setup, preferences and navigation. The series teaches fundamentals through complete workflows such as sketching, Part Design and STL export.

A beginner-focused tutorial on freehand knife sharpening with a single stone, aiming for a shaving-sharp edge in about five minutes.

DIY Perks builds a webcam mod using a two-way mirror in a box so the camera sits behind the screen image. This allows real eye contact on video calls.

In a long live-coding session, Andreas Kling works on making the Cookie Clicker game playable in the Ladybird browser from SerenityOS. He tracks down bugs in the browser engine and fixes them.

The trailer for Tim Hunkin's series The Secret Life of Components, eight guides to mechanical and electromechanical parts for designers and makers.

Loopop reviews the Polyend Tracker hardware tracker-style sequencer and walks through a tutorial from sampling to finishing a song. It covers most of the device's features.

DIY Perks shows how to modify devices that use older USB connectors so they charge and connect over USB Type-C. He solders in a USB-C connector board and works through cases such as dongle-dependent gadgets and a mouse receiver.

Andreas Kling live-codes a prototype JavaScript JIT compiler for the LibJS engine used in SerenityOS and Ladybird. He builds a standalone bytecode VM, a simple interpreter, and then a simple JIT in about 80 minutes.

A reupload of Joel Spolsky's talk teaching spreadsheet users the Excel features they are probably missing, such as keyboard navigation, named ranges, tables and lookups. The original disappeared and this copy comes from the Wayback Machine.