distributed training

The first lecture in Martin Kleppmann's 8-lecture distributed systems series from the University of Cambridge undergraduate course. It introduces the subject, and accompanying lecture notes are available.

Doug McGuff presents the biochemistry behind high-intensity strength training and the paleo diet, including how the body stores and burns fat. It is a roughly hour-and-a-half full-length lecture.

The opening lecture of MIT 6.824 Distributed Systems (Spring 2020), introducing the course and core challenges of distributed systems. It begins a playlist that goes on to cover Raft and other consensus papers in Go.

Rick Hartley gives a roughly two-hour live training on proper grounding in PCB design. He explains how energy actually flows in the space between conductors, and how that governs noise, EMI, return paths and signal reflections.

John Ousterhout lectures on the Raft consensus algorithm, made for the Raft user study comparing how students learn Raft and Paxos. It covers leader election and log repair.

Andrej Karpathy's three-hour-plus general-audience deep dive into how ChatGPT-style LLMs are built, covering the full training stack from pretraining to post-training. It also gives mental models for their quirks, like hallucination, and how to use them well.

Part one of an American Airlines training video presented by Captain Warren VanderBurgh on automation dependency. It grew out of a program on wake turbulence avoidance, and this restored version has the audio cleaned up.

An American Airlines training video by Captain Warren VanderBurgh on control malfunctions and flight instrument anomalies. It discusses real incidents such as runaway trim and instrument failures and how crews should respond.

A re-upload of American Airlines captain Warren Vanderburgh's 1997 presentation warning that pilots who over-rely on cockpit automation lose manual flying skills and awareness. The uploader adds context from his own flying.

John Ousterhout's slides-and-voiceover lecture on Paxos, made for the Raft user study comparing how students learn Raft and Paxos. It is a full introduction to the Paxos consensus algorithm.

Jeff Dean of Google describes his experiences building Google's systems and how its infrastructure evolved over time. The Stanford talk covers search, scaling tipping points and lessons from building large-scale software.

Andrej Karpathy's first Neural Networks: Zero to Hero lecture, which builds micrograd, a tiny autograd engine, from scratch in Python. It explains backpropagation and neural network training step by step, assuming only basic Python and some high-school calculus.

The first of Richard Feynman's 1964 Cornell Messenger Lectures, The Character of Physical Law, focusing on the law of gravitation. Feynman builds up from planetary motion to the nature of physical laws.

The introductory lecture of Richard Hamming's capstone course, The Art of Doing Science and Engineering: Learning to Learn. It focuses on style of thinking and on educating rather than training, using technical material only as illustration.

A short clip of Jordan Peterson explaining Pareto distributions, using Soviet farm collectivization and the resulting famine as context. It also covers how outcomes concentrate in a few people.

Part 2 of Richard Feynman's Messenger Lectures at Cornell, The Character of Physical Law, on the relation of mathematics to physics. He explains why understanding nature requires mathematics.