scale model

Sasha Rush surveys linear RNNs and state space models as replacements for attention in transformer-style models, in a talk for MLSys. It covers the foundational preliminaries and predates Mamba.

The first lecture of Andy Pavlo's CMU 15-445 Intro to Database Systems (Fall 2019), covering course introduction and the relational model.

A recording of Richard Feynman's talk on the possibilities of manipulating matter at very small scales, widely seen as an early vision of nanotechnology. This is a later version of his 1959 "There's Plenty of Room at the Bottom" lecture.

Andrej Karpathy's three-hour-plus general-audience deep dive into how ChatGPT-style LLMs are built, covering the full training stack from pretraining to post-training. It also gives mental models for their quirks, like hallucination, and how to use them well.

A lecture from MIT's Missing Semester course covering version control with git. It builds up git from its data model rather than from commands.

David Tong, a Cambridge theoretical physicist, explains at the Royal Institution that the fundamental building blocks of nature are quantum fields rather than particles. He covers what we know about these fields and how they fit into the Standard Model.

Jeff Dean of Google describes his experiences building Google's systems and how its infrastructure evolved over time. The Stanford talk covers search, scaling tipping points and lessons from building large-scale software.

Peter Norvig's UBC distinguished lecture on how massive amounts of simple data, such as for language modeling, can yield understanding that hand-built models could not.

Geoffrey Hinton's 2025 Royal Institution Discourse on what AI has learned from biological intelligence and how it might surpass it. He explains neural networks and argues that human language use resembles what backpropagation-trained networks do.

Nathan Kutz presents the spatio-temporal dynamics of rotating detonation rocket engines, including combustion fronts that behave like solitons. He shows a bifurcation analysis of a multiscale model that captures the main features.

The opening lecture of Robert Sapolsky's Stanford course on Human Behavioral Biology, explaining the course premise and how to avoid categorical thinking. It starts a roughly 25-lecture series on how biology, genes, hormones and environment shape behavior.

Zach Hartwig of MIT introduces the key concepts of magnetic fusion energy and the state of fusion research. He then presents MIT's proposed pathway of using high-field superconducting magnets to build smaller, cheaper tokamaks on a climate-relevant timescale.

An RSA Animate drawn from a Sir Ken Robinson talk arguing that current education systems are modeled on the industrial age. It discusses divergent thinking, standardization, and how schools disengage kids.

A roughly three-hour San Francisco workshop by Marshall Rosenberg on Nonviolent Communication, with full English subtitles added by a fan. He teaches the model with his jackal and giraffe language examples.

Economist Richard Wolff's Talks at Google lecture on his book Democracy at Work. He critiques capitalism and argues for worker-run cooperatives as a path to a more democratic economy.

A short Harvard Online animated lesson on how the mitochondrial electron transport chain works. It shows proton pumping and the machinery that drives ATP synthesis.

Leo Dirac explains how transformer models have replaced LSTMs in NLP. He gives background from bag of words through RNNs and LSTMs, then a technical deep dive into multi-headed self-attention and positional encoding, with sample code.

Stanford Health Care hosts Christopher Gardner and Robert Lustig on whether all calories are equal, with a focus on processed food and sugar. The talk questions the idea that calories in versus calories out fully explains weight and health.

Dr. Bruce Bugbee walks through the calculations for crop yield potential when light is the limiting factor, from photosynthetic quantum yield through respiration efficiency and harvest index, using the Energy Cascade Model.

Andres Gomez Emilsson of the Qualia Research Institute presents a model of DMT experiences using hyperbolic geometry and dynamical systems theory. He describes how different intoxication levels correspond to changing curvature and information content of experience.

Psychologist Irving Kirsch gives a distinguished lecture on antidepressant trials and the placebo effect. He argues drug-placebo differences are small outside severe depression.

Neuroscientist Karl Friston gives a 15-minute talk on the free energy principle, covering Markov blankets, Bayesian model evidence and global brain theories.

A 1990 lecture by James Gosling on NeWS, Sun's networked window system in which clients send PostScript programs to the server for execution. It covers the high-level imaging model and compares NeWS with similar systems.

A short clip of Richard Feynman on the difference between merely knowing how to reason mathematically and understanding why physical theories work. He discusses holding multiple equivalent ideas and guessing new laws.

Lecture 1B of MIT's 6.001 Structure and Interpretation of Computer Programs (1986) with Gerald Sussman, covering procedures, processes and the substitution model. It includes the line about the power of naming things.

The second talk in the Mill CPU series by Mill Computing, covering the Belt, the Mill's operand-passing model that replaces general registers. It explains the cost of register renaming in conventional wide CPUs and how the Belt reaches high instruction-level parallelism.