default mode network

Andrej Karpathy's first Neural Networks: Zero to Hero lecture, which builds micrograd, a tiny autograd engine, from scratch in Python. It explains backpropagation and neural network training step by step, assuming only basic Python and some high-school calculus.

Geoffrey Hinton's 2025 Royal Institution Discourse on what AI has learned from biological intelligence and how it might surpass it. He explains neural networks and argues that human language use resembles what backpropagation-trained networks do.

Casey Muratori's 2005 video introducing immediate-mode GUIs as an alternative to retained widget toolkits. He explains the motivation and shows minimal-state button logic.

Anders Hejlsberg whiteboards how compilers are taught versus how modern ones are actually built. He explains the shift to compilers as services with incremental, error-tolerant, IDE-oriented design, as in Roslyn and TypeScript.

Sasha Rush surveys linear RNNs and state space models as replacements for attention in transformer-style models, in a talk for MLSys. It covers the foundational preliminaries and predates Mamba.

The first lecture of Andy Pavlo's CMU 15-445 Intro to Database Systems (Fall 2019), covering course introduction and the relational model.

A Ninja Nerd whiteboard lecture on the Moderna, Pfizer/BioNTech and AstraZeneca COVID-19 vaccines. It covers how each works, the preclinical and phase I-III trial process, and Operation Warp Speed.

Geoffrey Hinton gives an MIT talk on what is wrong with convolutional neural networks and introduces his capsules project. The description points to the capsule network papers.

The first lecture of Stanford's CS231n course on convolutional neural networks for visual recognition. It surveys the history and key challenges of computer vision, from the Cambrian explosion and Hubel and Wiesel to ImageNet.

A 1990 lecture by James Gosling on NeWS, Sun's networked window system in which clients send PostScript programs to the server for execution. It covers the high-level imaging model and compares NeWS with similar systems.

The first class of Timothy Snyder's Yale course on the making of modern Ukraine. It introduces the course and asks what it means for a nation to exist in light of the Russian invasion.

A university lecture from CS480/680 by Pascal Poupart on attention mechanisms and transformer networks, worked through on a chalkboard.

The first lecture of Leonard Susskind's Stanford Continuing Studies course on modern physics, beginning with classical mechanics. It is the start of a six-quarter sequence on the theoretical foundations of physics.

Andrej Karpathy's three-hour-plus general-audience deep dive into how ChatGPT-style LLMs are built, covering the full training stack from pretraining to post-training. It also gives mental models for their quirks, like hallucination, and how to use them well.

A lecture from MIT's Missing Semester course covering version control with git. It builds up git from its data model rather than from commands.

David Tong, a Cambridge theoretical physicist, explains at the Royal Institution that the fundamental building blocks of nature are quantum fields rather than particles. He covers what we know about these fields and how they fit into the Standard Model.

Peter Norvig's UBC distinguished lecture on how massive amounts of simple data, such as for language modeling, can yield understanding that hand-built models could not.

Sean Carroll introduces his video series on the biggest ideas in physics, such as symmetry, space and matter, as informal discussions with follow-up Q&A videos. This is the short opening video of the series.

Rick Roderick's 1993 lecture on Baudrillard, the last in his series The Self Under Siege. It covers hyperreality, simulation and what Baudrillard calls fatal strategies.

An 86-minute Milton Friedman talk arguing that inflation is a monetary phenomenon caused by money supply growing faster than goods, and that the cure is less government spending and money printing.

Milton Friedman lectures to physicians on the economics of medical care, arguing that government involvement raises costs and leads toward socialized medicine. He also discusses licensing and protecting patients from quacks.

A Bell Labs film in which Dr. J.N. Shive uses a mechanical wave machine to demonstrate reflection, standing waves, resonance and impedance matching. He includes some equations but relies mostly on real-world examples a layperson can follow.

The first lecture of Gilbert Strang's MIT 18.06 Linear Algebra course, covering the geometry of linear equations. It opens a full 35-lecture university course.

Psychology professor Marty Lobdell gives a one-hour lecture on how to study effectively, covering short focused sessions with breaks, study environment, note-taking and memory techniques. It was aimed at students who cram without improving.

Casey Muratori's first refterm lecture lays out philosophies of optimization, distinguishing optimization from non-pessimization, which means avoiding needless work. It uses his fast terminal renderer project to show how fast computers really are.

An RSA Animate drawn from a Sir Ken Robinson talk arguing that current education systems are modeled on the industrial age. It discusses divergent thinking, standardization, and how schools disengage kids.

A roughly three-hour San Francisco workshop by Marshall Rosenberg on Nonviolent Communication, with full English subtitles added by a fan. He teaches the model with his jackal and giraffe language examples.

The first episode of John Vervaeke's lecture series on the modern meaning crisis, tracing its history through philosophy, cognitive science, religion and psychology. It introduces the series and its themes.

Economist Richard Wolff's Talks at Google lecture on his book Democracy at Work. He critiques capitalism and argues for worker-run cooperatives as a path to a more democratic economy.

Bill Hammack of engineerguy introduces his series on Michael Faraday's lectures on The Chemical History of a Candle. He describes the free companion book and the commentary and caption features that help modern viewers.

Leo Dirac explains how transformer models have replaced LSTMs in NLP. He gives background from bag of words through RNNs and LSTMs, then a technical deep dive into multi-headed self-attention and positional encoding, with sample code.

Stanford Health Care hosts Christopher Gardner and Robert Lustig on whether all calories are equal, with a focus on processed food and sugar. The talk questions the idea that calories in versus calories out fully explains weight and health.

Dr. Bruce Bugbee walks through the calculations for crop yield potential when light is the limiting factor, from photosynthetic quantum yield through respiration efficiency and harvest index, using the Energy Cascade Model.

A panel at The National WWII Museum on the Battle of Kursk, moderated by Keith Huxen with historians Robert Citino and John Parshal. The discussion covers the armored engagement and the German, Soviet and US approaches to tank production.

Weber State's Professor Kelly explains the Toyota RAV4 Hybrid transaxle, including its planetary gearset eCVT and all nine operating modes. It also covers how the engine reaches nearly 40 percent thermal efficiency.

The first lecture of Stanford's Natural Language Processing with Deep Learning course, taught by Chris Manning and Richard Socher. It introduces NLP and word vectors, including SVD, skip-gram, CBOW, negative sampling and word2vec.

Michael Levin presents his lab's work on how cellular collectives use bioelectric networks to make anatomical decisions. Topics include pattern memories, regeneration and synthetic living organisms.

Christof Paar's university lecture introducing Galois fields and finite-field arithmetic as used in AES. It covers the mathematics behind the AES S-box.

The first lecture of David MacKay's Cambridge course on information theory, pattern recognition and neural networks. It introduces the core ideas of his book Information Theory, Inference, and Learning Algorithms.

Andres Gomez Emilsson of the Qualia Research Institute presents a model of DMT experiences using hyperbolic geometry and dynamical systems theory. He describes how different intoxication levels correspond to changing curvature and information content of experience.