gradient descent

3Blue1Brown's second neural network chapter explains cost functions and gradient descent, showing how a network learns by minimizing error during training.

A short cartoon explaining how language models like ChatGPT work, from autocomplete and conditional probabilities to neural networks, gradient descent and backpropagation. It shows how networks act as universal function approximators.

Tom 7 (suckerpinch) delivers a long, comedic digression on gradient descent and floating-point imprecision. He shows how rounding behavior can supply the nonlinearity needed to build a neural network.

3Blue1Brown's first chapter on deep learning explains what neurons and layers are and the math underlying a basic neural network, using handwritten digit recognition with visual animations.

3Blue1Brown's third deep learning chapter gives a visual, intuitive account of backpropagation and what happens to a neural network as it learns. A follow-up video covers the underlying calculus.

3Blue1Brown's chapter 4 on deep learning gives a more formal, symbol-based account of backpropagation calculus, connecting the intuition from the previous chapter to the math found in textbooks and code.

MinutePhysics explains that computers store brightness nonlinearly, so blurring and blending colors in raw RGB gives wrong, dark results. It shows why mixed colors, such as in gradients, look off.

NASA's animated explanation of the Curiosity rover's Mars landing, which relied on a complex automated sequence taking about seven minutes. It features NASA engineers discussing the risks before the 2012 landing.

Technology Connections examines why light bulbs have the lifespans they do, including the real history of the Phoebus cartel. He shows that bulb life trades off against brightness and efficiency rather than being simple planned obsolescence.

PBS Space Time explores whether time causes gravity, explaining that gravity does not truly warp the flow of time but arises from time gradients. It revisits how gravitational time dilation works in general relativity.