deep learning

3Blue1Brown's visual walkthrough of the attention mechanism inside transformers, covering self-attention, multiple heads and cross-attention. It is chapter 6 of his deep learning series.

3Blue1Brown's visual explanation of how transformers and GPT-style language models work, tracing data through tokens, embeddings and attention.

Yosh trains a reinforcement learning agent to drive Trackmania until he can no longer beat it. The video explains how the training works and the design choices involved.

A Veritasium video on AlphaFold, DeepMind's protein structure prediction system, and the protein design work it enabled. It features interviews with John Jumper and with David Baker's protein design group and explains why predicting protein folding matters.

A Welch Labs explainer on neural scaling laws and the compute-efficient frontier, asking why model loss seems to hit a line it cannot cross. It draws an analogy to an ideal gas law for AI.

Veritasium debunks the idea of learning styles, such as being a visual learner, with an interview with Daniel Willingham and a memory experiment. It argues that a multimodal approach helps everyone.

Robert Miles covers a paper where researchers ran real versions of his earlier mesa-optimizer thought experiments. They show inner misalignment, where an AI learns the wrong goal in training and misbehaves when deployed.

Veritasium explains why analog computing may suit AI workloads, covering old analog computers, The Analog Thing and Mythic's analog chips that use flash memory for neural network inference. It argues digital hardware is hitting limits.

A short cartoon explaining how language models like ChatGPT work, from autocomplete and conditional probabilities to neural networks, gradient descent and backpropagation. It shows how networks act as universal function approximators.

Roaring Kitty's July 2020 analysis of GameStop, arguing a bullish deep-value case when the stock was about $4 and short interest exceeded 100%. It covers fundamentals, cash balance and technicals.

Soup Emporium's deep dive argues that Yellowstone is not a ticking timebomb. It goes through uplift and subsidence, earthquakes and what the caldera really is, to rebut supervolcano doom claims.

Tom 7 (suckerpinch) delivers a long, comedic digression on gradient descent and floating-point imprecision. He shows how rounding behavior can supply the nonlinearity needed to build a neural network.

A guest video by Welch Labs on 3Blue1Brown explaining how text-to-image and video models work. It covers CLIP, shared embedding spaces, diffusion models (DDPM, DDIM), conditioning, guidance and negative prompts.

Rob Miles discusses GPT-3 on Computerphile, covering how scaling parameters kept improving results over GPT-2 and how the model nearly learned arithmetic without anyone knowing exactly how.

Veritasium examines which experts have real expertise, drawing on chess research and work by Klein and Kahneman. It explains that expertise comes from pattern recognition built through deliberate practice in valid, feedback-rich environments.

Kurzgesagt's hour-long animated film that compresses Earth's 4.5 billion year history into one hour, roughly a million years per second. It follows the evolution of life through to humanity's tiny final stretch.

Kyle Hill explains what nuclear waste actually is and how it is stored, arguing that the problem was effectively solved decades ago. It covers solid shielded waste and deep geological storage.

Gamers Nexus benchmarks the Ryzen 9 7950X in its BIOS Eco Mode presets (65W, 105W and stock 170W). It measures the performance cost against the power and heat savings.

A long video essay on the claim that chemicals such as atrazine are feminizing frogs. It covers the science, the EPA and the role of chemical companies.

CGP Grey argues for picking a theme for the year or season instead of setting goals or new year's resolutions. He explains how a theme gives direction without a pass/fail target.

CGP Grey argues that your brain treats a whole home as one room during lockdown, blurring work, rest and leisure. He recommends creating separate spaces and routines for different activities to stay balanced.

Zack Freedman gives advice on why makers fail to finish projects, including scrapping bad ideas, showing work publicly and writing a plan that keeps projects fun. It is aimed at hardware DIY but generalizes.

CGP Grey argues that the two-day weekend is poorly structured and proposes taking days off midweek, such as Wednesday and Sunday, instead.

Harvard professor Arthur Brooks explains why boredom is useful rather than something to avoid. He describes how a wandering mind engages the brain's default mode network, which supports creativity and curiosity, and suggests it may protect against depression.

Kaze Emanuar explains how he rewrote and optimized the Super Mario 64 source code so it runs far faster on real N64 hardware. He covers performance bottlenecks and fixes in detail for his ROM hacks.

Technology Connections takes a long, detailed look at how a 1970s electromechanical pinball machine works, from relays to stepper motors and mechanical logic. It is the first part of a series.

Technology Connections' long closing video in his heat pump series, arguing that adopting heat pumps is well within reach. It explains how they work and what it takes to start using them.

A 36-minute animated deep dive from Branch Education into how DRAM works. It shows how memory connects to the CPU and how billions of bits are stored in nanoscale capacitor cells. It also covers why DRAM sits between SSDs and the processor.

Retro Game Mechanics Explained dissects how Atari's Quadrascan vector displays and vector generator hardware drew games like Asteroids and Tempest.

Climate Town gives a comedic, fast-paced account of how the plastics industry promoted recycling, including the resin-code recycling symbol, while knowing most plastic could not be economically recycled. It points viewers to the Frontline documentary Plastic Wars for a deeper treatment.

Branch Education's animated deep dive into ASML's EUV photolithography machine and how it prints nanometer-scale transistors onto chips. It covers the system's components and the process of chip manufacturing.

WIRED has UCLA professor Amit Sahai explain zero-knowledge proofs to a child, a teen, a college student, a grad student and an expert. Each round goes deeper into the cryptography and why it matters.

A PBS Space Time episode on how the Higgs mechanism gives particles mass, prompted by Fermilab's heavier-than-expected W boson measurement. It goes beyond the usual pop-science treatment without heavy math.

Veritasium explains how ASML's EUV lithography machines make the most advanced computer chips, covering the engineering of the light source, mirrors and the supply chain around them. It is a long-form explainer on the world's most complex commercial machine.

Noodle explores how retro pixel art was designed for CRT displays and why games look different on LCDs, with input from pixel artists and CRT researchers.

Tim Dodd's hour-long deep dive on how rocket engines start, from solid motors to liquid engines. It covers thermal conditioning, spin-up, ignition methods, starting in space, and a step-by-step RS-25 startup.

A Veritasium video that follows the principle of least action from Bernoulli and Newton to quantum mechanics, asking whether light takes all possible paths at once. It includes experiments showing quantum waves.

Scott Manley examines why SpaceX, Google and others are looking at orbital data centers. He walks through the economics, heat rejection and solar power arguments, with links to the Lumen/Starcloud and Google Suncatcher papers.

3Blue1Brown introduces group theory and abstract groups, then builds toward classification of finite simple groups and the enormous Monster group with its 196,883 dimensions.

Kurzgesagt asks whether advanced civilizations could have existed on Earth in the deep past and left little evidence. It looks at time as a dimension for searching for alien civilizations and the limits of the geological record.