learning

3Blue1Brown's first chapter on deep learning explains what neurons and layers are and the math underlying a basic neural network, using handwritten digit recognition with visual animations.

3Blue1Brown's visual walkthrough of the attention mechanism inside transformers, covering self-attention, multiple heads and cross-attention. It is chapter 6 of his deep learning series.

3Blue1Brown's third deep learning chapter gives a visual, intuitive account of backpropagation and what happens to a neural network as it learns. A follow-up video covers the underlying calculus.

3Blue1Brown's second neural network chapter explains cost functions and gradient descent, showing how a network learns by minimizing error during training.

3Blue1Brown's visual explanation of how transformers and GPT-style language models work, tracing data through tokens, embeddings and attention.

3Blue1Brown's chapter 4 on deep learning gives a more formal, symbol-based account of backpropagation calculus, connecting the intuition from the previous chapter to the math found in textbooks and code.

Veritasium debunks the idea of learning styles, such as being a visual learner, with an interview with Daniel Willingham and a memory experiment. It argues that a multimodal approach helps everyone.

Yosh trains a reinforcement learning agent to drive Trackmania until he can no longer beat it. The video explains how the training works and the design choices involved.

Matt Parker of Stand-up Maths demonstrates MENACE, Donald Michie's 1961 machine made of matchboxes that learns to play noughts and crosses through reinforcement. He builds and trains a physical version.

Veritasium examines which experts have real expertise, drawing on chess research and work by Klein and Kahneman. It explains that expertise comes from pattern recognition built through deliberate practice in valid, feedback-rich environments.

Robert Miles explains reward modelling, in which an AI learns what humans want from their preference comparisons instead of a hand-written reward function. He walks through the 2017 paper on deep reinforcement learning from human preferences.

Veritasium examines research suggesting science explainer videos like Khan Academy's make students feel they understand while tests show they have not learned, because misconceptions go unaddressed. It suggests how to partly fix this.

A Veritasium explainer on how the brain works and how we learn. It is inspired by Kahneman's Thinking, Fast and Slow and covers System 1 and System 2 thinking and why harder learning builds skill.

Yannic Kilcher walks through the Attention Is All You Need paper, which introduced the Transformer, a sequence model based solely on attention without recurrence or convolutions. He reviews the architecture and the paper's translation results.

A Veritasium video on AlphaFold, DeepMind's protein structure prediction system, and the protein design work it enabled. It features interviews with John Jumper and with David Baker's protein design group and explains why predicting protein folding matters.

A Welch Labs explainer on neural scaling laws and the compute-efficient frontier, asking why model loss seems to hit a line it cannot cross. It draws an analogy to an ideal gas law for AI.

Robert Miles covers a paper where researchers ran real versions of his earlier mesa-optimizer thought experiments. They show inner misalignment, where an AI learns the wrong goal in training and misbehaves when deployed.

Yuta asks whether native Japanese speakers can actually write kanji by hand, showing that many struggle to recall characters from memory.

CGP Grey explains that postal codes are routing instructions for mail rather than geographic regions. He looks at the quirks and problems this causes.

Rob Miles explains on Computerphile how language models generate plausible text and how transformers improved on recurrent networks, with a look at what comes next.

A short cartoon explaining how language models like ChatGPT work, from autocomplete and conditional probabilities to neural networks, gradient descent and backpropagation. It shows how networks act as universal function approximators.

Dr. K of HealthyGamerGG argues that gifted kids can be seen as special needs, tracing a path from the gifted label to burnout and perfectionism.

agadmator walks through a game in which DeepMind's AlphaZero beat Stockfish, ending in a famous zugzwang that leaves the engine helpless. He gives commentary on the moves.

CGP Grey explains the mess of Daylight Saving Time, including its dubious energy savings and the odd cases like Arizona that opt out. It is a short, simple explainer.

Tom 7 (suckerpinch) delivers a long, comedic digression on gradient descent and floating-point imprecision. He shows how rounding behavior can supply the nonlinearity needed to build a neural network.

A guest video by Welch Labs on 3Blue1Brown explaining how text-to-image and video models work. It covers CLIP, shared embedding spaces, diffusion models (DDPM, DDIM), conditioning, guidance and negative prompts.

A short TED-Ed animated lesson by Anita Collins on what happens in the brain when people play a musical instrument. It argues that playing engages many brain areas at once, like a full-body workout, with long-term benefits.

A two-minute animation of an Alan Watts talk arguing that life is like music: it is meant to be danced to in the moment, not rushed toward a final goal. It is a short, accessible take on living in the present.

CGP Grey argues for picking a theme for the year or season instead of setting goals or new year's resolutions. He explains how a theme gives direction without a pass/fail target.

CGP Grey argues that your brain treats a whole home as one room during lockdown, blurring work, rest and leisure. He recommends creating separate spaces and routines for different activities to stay balanced.

CGP Grey's sarcastic animated video adapted from the book How to Be Miserable, listing habits that reliably make people unhappy. By inverting the advice, it shows what to avoid and prompts reflection on goals and routines.

A short How to ADHD explainer, featuring Brendan Mahan, on why simple tasks can feel impossible for people with ADHD. It introduces the 'wall of awful', a pile of past failures, shame and anxiety that builds up in front of a task and blocks starting it.

CGP Grey explains why "Indian" is often preferred over "Native American" in the United States, especially near reservations, and how many tribes exist in the US. He draws on conversations with people who identify as Indian.

Vsauce's explainer on Zipf's law, the pattern in which the frequency of a word is inversely related to its rank. It shows the pattern across many domains and discusses why it remains unexplained.

Vox explains the Berlin and Kay research showing that languages around the world tend to invent color words in the same order. It walks through the hierarchy and the debate around it.

The Map Men explain why British place names are so hard to pronounce, tracing it to layers of Viking, Anglo-Saxon, Celtic and Norman influence, with a pronunciation guide.

Linguist Simon Roper reconstructs how a London accent would have sounded from the 14th to the 21st centuries, reading passages in period pronunciation. It draws on the Cambridge History of the English Language.

Tom Scott-style exploration by suckerpinch (Tom7) of generalized anagrams where letters can be broken into pieces, called anagraphs, with a whimsical computational approach.

Zack Freedman gives advice on why makers fail to finish projects, including scrapping bad ideas, showing work publicly and writing a plan that keeps projects fun. It is aimed at hardware DIY but generalizes.

Vox breaks down how great rappers build rhymes, from Kurtis Blow's simple bars to Biggie's smooth flow and Kendrick Lamar's dense, fast delivery. It uses on-screen visualizations of rhyme structure.