deep time

Physicist Carlo Rovelli gives a public lecture at the Royal Institution on how our understanding of time has changed, from Boltzmann and Einstein to quantum theory and loop quantum gravity. He blends physics, philosophy and art to argue that time is stranger than everyday intuition suggests.

Carnegie Mellon professor Randy Pausch gives a lecture on time management at the University of Virginia in 2007. He covers practical habits such as tackling important tasks first and distinguishing important from urgent work.

The first lecture of Stanford's Natural Language Processing with Deep Learning course, taught by Chris Manning and Richard Socher. It introduces NLP and word vectors, including SVD, skip-gram, CBOW, negative sampling and word2vec.

Leonard Susskind's Santa Fe Institute talk on the arrow of time: why the past differs from the future when physics equations are time-symmetric. He covers entropy, cosmology and Boltzmann brains.

Bill Dally of NVIDIA gives a University of Washington lecture on trends in deep learning hardware. It covers numeric formats, specialized instructions, energy per operation and co-design of hardware and software.

Andrej Karpathy's three-hour-plus general-audience deep dive into how ChatGPT-style LLMs are built, covering the full training stack from pretraining to post-training. It also gives mental models for their quirks, like hallucination, and how to use them well.

Sacha Arnoud, Waymo's Director of Engineering, gives a lecture in MIT's 2018 deep learning for self-driving cars course on the rise of machine learning in autonomous vehicles. It covers how Waymo uses deep learning and how it handles tricky driving situations.

Dan Britt lectures on the history of climate, covering orbital cycles, ice ages and conditions millions of years ago. It frames current climate debate with deep-time context.

Patrick Winston's long-running MIT lecture on public speaking teaches heuristic rules for talks. It covers how to start, use time and place, boards, props and slides, and how to inform, persuade and finish.

Jean-Marc Jancovici lectures at ENS Paris on whether energy use, jobs and growth can all be preserved. He argues for a physical approach to economics, since resource depletion and climate limits make perpetual GDP growth unrealistic.

Historian Timothy Snyder explains the politics of inevitability and the politics of eternity, two ways of thinking about time that frame his books On Tyranny and The Road to Unfreedom.

The first lecture of Stanford's CS231n course on convolutional neural networks for visual recognition. It surveys the history and key challenges of computer vision, from the Cambrian explosion and Hubel and Wiesel to ImageNet.

Randy Pausch's 2007 last lecture at Carnegie Mellon, given as he was dying of pancreatic cancer. He reflects on achieving childhood dreams, overcoming obstacles and helping others reach theirs.

Richard Hamming's 1995 recording of his talk 'You and Your Research', drawn from his graduate engineering course. He discusses how great scientists pick important problems and build careers, drawing on his years at Bell Labs.

Psychology professor Marty Lobdell gives a one-hour lecture on how to study effectively, covering short focused sessions with breaks, study environment, note-taking and memory techniques. It was aimed at students who cram without improving.

A roughly three-hour San Francisco workshop by Marshall Rosenberg on Nonviolent Communication, with full English subtitles added by a fan. He teaches the model with his jackal and giraffe language examples.

Larry McEnerney of the University of Chicago Writing Program argues that good writing is defined by what readers value, not by rules or the writer's own ideas. He explains why academic habits fail outside academia and how to write so readers find the work valuable.

The final lecture of Richard Hamming's Learning to Learn course, from 1995, based on his well-known talk 'You and Your Research'. It covers how to do important work and build a career.

The introductory lecture of Richard Hamming's capstone course, The Art of Doing Science and Engineering: Learning to Learn. It focuses on style of thinking and on educating rather than training, using technical material only as illustration.

Randy Pausch, a Carnegie Mellon computer scientist and virtual reality pioneer who was dying of cancer, gives his 'Last Lecture' about achieving childhood dreams and living well. The recording is a full-length talk of about 104 minutes.

Leo Dirac explains how transformer models have replaced LSTMs in NLP. He gives background from bag of words through RNNs and LSTMs, then a technical deep dive into multi-headed self-attention and positional encoding, with sample code.

A university lecture from CS480/680 by Pascal Poupart on attention mechanisms and transformer networks, worked through on a chalkboard.

Geoffrey Hinton gives an MIT talk on what is wrong with convolutional neural networks and introduces his capsules project. The description points to the capsule network papers.

Zach Hartwig of MIT introduces the key concepts of magnetic fusion energy and the state of fusion research. He then presents MIT's proposed pathway of using high-field superconducting magnets to build smaller, cheaper tokamaks on a climate-relevant timescale.

The first lecture of MIT's 6.001 (SICP) with Abelson and Sussman, giving an overview of the course and an introduction to Lisp. It argues that computer science is about managing complexity and abstraction, not computers.

Casey Muratori's lecture, originally given at the Technical University of Madrid, arguing that Conway's Law is the only viable candidate for a true law of software architecture. He explains how software mimics the organization over time, using examples like Windows' multiple volume controls.

Dr. Roger Seheult of MedCram reviews the benefits of sunlight beyond vitamin D, covering the solar spectrum, circadian rhythm, melatonin and infrared light. The lecture runs nearly two hours with timestamps.

A lecture by Richard Feynman on how computers work, using the analogy of a filing clerk that becomes progressively dumber and faster. It also covers heuristics and how computers handle data and solve problems in finite time.

Casey Muratori's University of Twente guest lecture is a case study in how straightforward code can cut thousands of lines and tens of seconds of runtime down to a few dozen lines running in under a second. It uses concrete examples to show why software is often an order of magnitude slower than it should be.

Kurt Vonnegut's 2004 Case College lecture, with Spanish subtitles, in which he sketches the shapes of stories on a blackboard. He plots story arcs as good and bad fortune against time.

Part two of Alan Kay's Stanford Startup School lecture on inventing the future. He draws on his time at Xerox PARC and elsewhere to discuss how to think about new technology and what makes ideas useful.

Andrej Karpathy builds the GPT tokenizer from scratch, implementing byte pair encoding along with encode and decode. He shows how many odd LLM behaviors trace back to tokenization, and covers Unicode byte encodings along the way.

Leonard Bernstein's 1973 Norton Lectures at Harvard, starting with Musical Phonology. He draws analogies between music and linguistics, including references to Chomsky.

Michael Sugrue's lecture on Marcus Aurelius' Meditations and the Stoic ideal, covering the text and its philosophy. It is one of his humanities lectures known for their clarity.

A professor from Illinois compares the cost of building, fueling and operating a nuclear plant against a natural gas plant, using visual charts. It shows how construction time and interest rates dominate, when the investment pays off and when costs cross over.

Jeff Dean of Google describes his experiences building Google's systems and how its infrastructure evolved over time. The Stanford talk covers search, scaling tipping points and lessons from building large-scale software.

The opening lecture of the How to Start a Startup course at Stanford, with Sam Altman covering ideas and products and Dustin Moskovitz discussing why to start a startup.

Chris Shore of the Centre for Computing History explains how Colossus was built, how it worked, and how it affected the course of World War II. It is an hour-long museum lecture on the codebreaking computer.

Timothy Gowers thinks aloud, in real time, as he tries to understand why Pascal's determinant equals 1. He does not fully solve it in this episode, but shows his exploratory process.

Rhonda Patrick of FoundMyFitness makes a case for isothiocyanates such as sulforaphane from cruciferous vegetables and broccoli sprouts. It covers cancer, aging, heart disease, brain and behavior, and neurodegeneration, with chapter timestamps.