self-paced learning

3Blue1Brown's first chapter on deep learning explains what neurons and layers are and the math underlying a basic neural network, using handwritten digit recognition with visual animations.

3Blue1Brown explains fractal dimension and shows why many fractals are not strictly self-similar. Self-similarity turns out to be a special case of the broader idea of fractional dimension.

3Blue1Brown's visual walkthrough of the attention mechanism inside transformers, covering self-attention, multiple heads and cross-attention. It is chapter 6 of his deep learning series.

Veritasium debunks the idea of learning styles, such as being a visual learner, with an interview with Daniel Willingham and a memory experiment. It argues that a multimodal approach helps everyone.

3Blue1Brown's third deep learning chapter gives a visual, intuitive account of backpropagation and what happens to a neural network as it learns. A follow-up video covers the underlying calculus.

3Blue1Brown's second neural network chapter explains cost functions and gradient descent, showing how a network learns by minimizing error during training.

Yosh trains a reinforcement learning agent to drive Trackmania until he can no longer beat it. The video explains how the training works and the design choices involved.

3Blue1Brown's visual explanation of how transformers and GPT-style language models work, tracing data through tokens, embeddings and attention.

An animated 11-minute tour of the whole field of mathematics as a single map, showing how pure and applied math and their sub-fields relate to each other.

Matt Parker of Stand-up Maths demonstrates MENACE, Donald Michie's 1961 machine made of matchboxes that learns to play noughts and crosses through reinforcement. He builds and trains a physical version.

CGP Grey explains how traffic jams come from human driving behavior such as tailgating and reaction delays, and how leaving gaps and smoothing speed would reduce congestion. It also touches on self-driving cars.

Kurzgesagt makes a selfish case for improving the world, arguing that helping people far away raises prosperity and innovation for everyone, including yourself. The animated video frames this as egoistic altruism and positive-sum cooperation.

A video essay from Every Frame a Painting about Vancouver, a major film production city that almost never appears onscreen as itself. It shows clips of films and TV shot there that pass the city off as somewhere else.

Two Minute Papers covers OpenAI's multi-agent hide-and-seek experiment, in which agents learned emergent tool use and found ways to break the game's rules. It summarizes the 'Emergent Tool Use from Multi-Agent Interaction' paper.

3Blue1Brown's chapter 4 on deep learning gives a more formal, symbol-based account of backpropagation calculus, connecting the intuition from the previous chapter to the math found in textbooks and code.

3kliksphilip summarizes Valve's GDC talk on VACNet, a deep-learning system that flags CS:GO cheaters and feeds the Overwatch review queue. It covers Trust Factor, VAC, and how the data is collected and analyzed.

Veritasium examines which experts have real expertise, drawing on chess research and work by Klein and Kahneman. It explains that expertise comes from pattern recognition built through deliberate practice in valid, feedback-rich environments.

FortNine explains how Harley-Davidson ended up in decline, from a narrow lifestyle niche and an aging customer base to the pandemic hitting a company already in trouble.

Robert Miles explains reward modelling, in which an AI learns what humans want from their preference comparisons instead of a hand-written reward function. He walks through the 2017 paper on deep reinforcement learning from human preferences.

The Thought Emporium's update on the home-brewed gene therapy he took to cure his lactose intolerance. It reports how the effect held up over two years and what future versions might look like.

Veritasium explains why many real-world systems follow power laws rather than normal distributions. It covers self-organized criticality, with simulations of sandpiles, magnetism and forest fires.

Veritasium examines research suggesting science explainer videos like Khan Academy's make students feel they understand while tests show they have not learned, because misconceptions go unaddressed. It suggests how to partly fix this.

A re-upload of a video breaking down Eminem's rhyme schemes, showing multi-syllable and internal rhymes in songs such as Lose Yourself. It aims to show why he is considered a standout lyricist.

A short minutephysics video explaining why bicycles stay upright. It looks at gyroscopic precession, head angle and centre of mass, and shows that bikes self-steer toward the direction they lean.

Andreas Antonopoulos answers a question about how to secure your Bitcoin. He covers holding your own keys, backing up the 12 to 24 word seed phrase, and the tradeoffs of custodial accounts, phone wallets and hardware wallets.

A short TED-Ed animated lesson by Anita Collins on what happens in the brain when people play a musical instrument. It argues that playing engages many brain areas at once, like a full-body workout, with long-term benefits.

A Veritasium explainer on how the brain works and how we learn. It is inspired by Kahneman's Thinking, Fast and Slow and covers System 1 and System 2 thinking and why harder learning builds skill.

Two Minute Papers covers a paper on speeding up fluid and smoke simulation with convolutional networks. It contrasts the approach with earlier regression forest methods.

Yuta asks whether native Japanese speakers can actually write kanji by hand, showing that many struggle to recall characters from memory.

A short animation from the DNA Learning Center showing how mRNA carries a gene's message to the ribosome, where tRNA and codons are used to assemble amino acids into a protein.

CGP Grey argues for picking a theme for the year or season instead of setting goals or new year's resolutions. He explains how a theme gives direction without a pass/fail target.

CGP Grey's sarcastic animated video adapted from the book How to Be Miserable, listing habits that reliably make people unhappy. By inverting the advice, it shows what to avoid and prompts reflection on goals and routines.

Yannic Kilcher walks through the Attention Is All You Need paper, which introduced the Transformer, a sequence model based solely on attention without recurrence or convolutions. He reviews the architecture and the paper's translation results.

A Veritasium video on AlphaFold, DeepMind's protein structure prediction system, and the protein design work it enabled. It features interviews with John Jumper and with David Baker's protein design group and explains why predicting protein folding matters.

A Welch Labs explainer on neural scaling laws and the compute-efficient frontier, asking why model loss seems to hit a line it cannot cross. It draws an analogy to an ideal gas law for AI.

Robert Miles covers a paper where researchers ran real versions of his earlier mesa-optimizer thought experiments. They show inner misalignment, where an AI learns the wrong goal in training and misbehaves when deployed.

Tom Scott explains for Computerphile why handling time and timezones in code is so hard, walking through a simple web app that computes how long ago something happened. It covers the quirks of timezones and calendars and ends in an exasperated rant.

PBS Space Time argues that the speed of light is better understood as the speed of causality, the universal limit on how fast cause and effect propagate. Light travels at that speed because it is massless, but the limit itself is a property of spacetime.

Veritasium's explainer on Godel's incompleteness theorems and the limits of mathematical proof, tracing set theory, Hilbert's program and the road to Turing and modern computing.

Robert Miles explains instrumental convergence: why an AGI with almost any goal would tend to pursue sub-goals like self-preservation and resource acquisition. It builds on Omohundro's basic AI drives and his orthogonality thesis video.