soft language

Andrej Karpathy builds a bigram character-level language model from scratch, introducing torch.Tensor and the framework of training, sampling and loss evaluation. It is the first step toward a GPT-style Transformer in his makemore series.

Jeremy Howard's 90-minute practical tour of language models. It covers how they work, GPT-4's capabilities and limits, using the OpenAI API, code writing, data analysis and fine-tuning.

David Sanders gives the first part of a two-part introduction to the Julia programming language at SciPy 2014. It walks through the language's basics and its appeal for scientific computing.

The first part of a series on programming in Jai, Jonathan Blow's in-development language. It covers compiling, writing hello world and using code from other files.

Bisqwit builds a Doom or Duke Nukem 3D style software-rendered 3D engine in C from scratch, supporting non-Euclidean geometry. It covers vector rotation and portal rendering with sped-up, tool-assisted coding.

Ben Eater writes a program in a made-up machine language and walks through the control logic an 8-bit breadboard CPU needs to execute it. It is part of his build-an-8-bit-computer series.

A tutorial in the GAS Therapy series showing how to recreate the Teenage Engineering OP-1 and OP-1 Field with free software. It argues you do not need to buy expensive gear to make music.

Andrej Karpathy builds a GPT from scratch in code, following Attention Is All You Need and GPT-2/3, in about two hours using PyTorch. He connects it to ChatGPT and assumes familiarity with his earlier makemore videos.

Day 1 of Handmade Hero's introduction to C on Windows, covering setting up Visual Studio, creating a Win32 project, the WinMain entry point and writing a first function. It is the starting point for Casey Muratori's from-scratch game series.

A 1930s Chevrolet training film explaining the principles and development of the differential gear. It builds the idea step by step from first principles to the finished mechanism.

David Beazley's PyCon 2019 tutorial derives the lambda calculus from the ground up in Python, using only single-argument functions. He builds booleans, numerals and more with no other language features.

The first part of Robert Baruch's series on building a 6800 CPU on an FPGA with nMigen, a Python-based hardware description language. It introduces the HDL while implementing a simpler 6800 core.

Harry Schwartz gives a roughly hour-long tour of Emacs Org mode as an outliner, task manager, markup language and agenda tool. He demonstrates how he uses it for documents, presentations and todo lists.

The Thought Emporium shows how to receive clear images directly from GOES-15, 16 and 17 and Himawari 8 geostationary weather satellites with software-defined radio. It covers the extra effort needed to receive GOES data.

Markus Triska tours Prolog's most distinctive features, including its use as a database and query language, rule processing, constraint solving and compile-time rewriting. It also covers concise meta-interpreters.

Animator Joel Haver explains how he makes his short films using rotoscoping and the EbSynth tool, along with the software he uses. The method is a labor-intensive, frame-by-frame process.