from scratch

Lawrence Krauss's 2009 talk on the current picture of the universe, how it will end and how it could have come from nothing. It covers the expanding universe, cosmic background radiation and the cosmological constant.

Simon Peyton Jones gives Churchill College's annual computer science lecture on Haskell's birth and evolution. He covers the most influential ideas, from laziness to monads and type system evolution, plus current developments and guesses about the future.

Dr. Russell Barkley explains how different ADHD medications work and how they differ from one another, in a short clip.

Casey Muratori's invited lecture on where bad code comes from, rebroadcast from a Twitch stream. He critiques conventional wisdom such as SOLID and Clean Code and argues about how those habits lead to slow, poorly structured software.

A short clip of Milton Friedman explaining who benefits from occupational licensing requirements, arguing they mainly protect practitioners from competition.

The first episode of John Vervaeke's lecture series on the modern meaning crisis, tracing its history through philosophy, cognitive science, religion and psychology. It introduces the series and its themes.

A 78-minute Richard Feynman lecture of anecdotes about working at Los Alamos on the Manhattan Project, followed by about ten minutes of audience Q&A in which he tells three safe-cracking stories.

Andrej Karpathy's first Neural Networks: Zero to Hero lecture, which builds micrograd, a tiny autograd engine, from scratch in Python. It explains backpropagation and neural network training step by step, assuming only basic Python and some high-school calculus.

Andrej Karpathy builds the GPT tokenizer from scratch, implementing byte pair encoding along with encode and decode. He shows how many odd LLM behaviors trace back to tokenization, and covers Unicode byte encodings along the way.

The first lecture in an 18-part series on digital photography from Marc Levoy's Stanford CS 178 course, recorded at Google in 2016. The series covers how digital cameras work and computational photography, with slides and assignments available on the course site.

The first lecture of Stanford's CS107 Programming Paradigms, taught by Jerry Cain, giving an overview of the course. The course goes from C and assembly through C++, concurrency, Scheme and Python.

Milton Friedman explains why the US tax code is enormously complex and why meaningful reform is unlikely. He argues that politicians profit from the complexity, since tax breaks are products they sell and the code works as a tool of reward and punishment. The clip is about 14 minutes from his lecture series.

Vladimir Voevodsky's IAS lecture starts from Godel's second incompleteness theorem to explore whether first-order arithmetic could be inconsistent. It motivates his vision of univalent foundations and computer-checked proofs.

Leonard Susskind's Santa Fe Institute talk on the arrow of time: why the past differs from the future when physics equations are time-symmetric. He covers entropy, cosmology and Boltzmann brains.

A short clip from Udacity's Web Development course in which Reddit co-founder Steve Huffman describes how Reddit grew early on. He explains seeding the site with content from fake accounts.

Stanford professor Robert Sapolsky lectures on depression as a real biological disease. He covers its biological and psychological causes, how it differs from ordinary sadness, and ideas such as learned helplessness. He ties these together into one account.

A re-upload of American Airlines captain Warren Vanderburgh's 1997 presentation warning that pilots who over-rely on cockpit automation lose manual flying skills and awareness. The uploader adds context from his own flying.

Richard Hamming's 1995 recording of his talk 'You and Your Research', drawn from his graduate engineering course. He discusses how great scientists pick important problems and build careers, drawing on his years at Bell Labs.

Microsoft's Brian Beckman gives an hour-long, whiteboard-style walk through monads, building from function composition and monoids using school-level math. It is aimed at practicing programmers rather than category theorists.

Andrej Karpathy's three-hour-plus general-audience deep dive into how ChatGPT-style LLMs are built, covering the full training stack from pretraining to post-training. It also gives mental models for their quirks, like hallucination, and how to use them well.

Psychology professor Marty Lobdell gives a one-hour lecture on how to study effectively, covering short focused sessions with breaks, study environment, note-taking and memory techniques. It was aimed at students who cram without improving.

Casey Muratori's first refterm lecture lays out philosophies of optimization, distinguishing optimization from non-pessimization, which means avoiding needless work. It uses his fast terminal renderer project to show how fast computers really are.

An RSA Animate drawn from a Sir Ken Robinson talk arguing that current education systems are modeled on the industrial age. It discusses divergent thinking, standardization, and how schools disengage kids.

A short excerpt from Dr Russell Barkley's 2012 Burnett Lecture on ADHD, focused on treatment. He argues ADHD is a disorder of executive function and self-regulation, and that environments should be designed to compensate.

A lecture from MIT's Missing Semester course covering version control with git. It builds up git from its data model rather than from commands.

The first clip from Russell Barkley's 30 Essential Ideas about ADHD series, introducing ADHD as a chronic developmental disability. It is part of a lecture series on the disorder by a leading ADHD researcher.

Douglas Hofstadter's Stanford Presidential Lecture argues that analogy is the core of cognition, illustrating how concepts, categorization and thought arise from analogy-making.

The first of Richard Feynman's 1964 Cornell Messenger Lectures, The Character of Physical Law, focusing on the law of gravitation. Feynman builds up from planetary motion to the nature of physical laws.

Physicist Carlo Rovelli gives a public lecture at the Royal Institution on how our understanding of time has changed, from Boltzmann and Einstein to quantum theory and loop quantum gravity. He blends physics, philosophy and art to argue that time is stranger than everyday intuition suggests.

Jack Szostak's lecture covers how cellular life could have arisen from chemistry on the early Earth, starting from the odds of life elsewhere in the galaxy. It is part of a series on protocells and the RNA world.

Peter Thiel's lecture from the How to Start a Startup course on business strategy and monopoly theory, arguing that competition destroys profits and that startups should aim to build monopolies. It covers the ideas of Zero to One.

The opening lecture of MIT 6.824 Distributed Systems (Spring 2020), introducing the course and core challenges of distributed systems. It begins a playlist that goes on to cover Raft and other consensus papers in Go.

Database pioneer Michael Stonebraker argues that 'big data' is really at least four different problems: big volumes with small analytics, big analytics, velocity, and variety. He comments on where each market is heading.

The first lecture in Martin Kleppmann's 8-lecture distributed systems series from the University of Cambridge undergraduate course. It introduces the subject, and accompanying lecture notes are available.

Carnegie Mellon professor Randy Pausch gives a lecture on time management at the University of Virginia in 2007. He covers practical habits such as tackling important tasks first and distinguishing important from urgent work.

Utah State plant scientist Bruce Bugbee presents his analysis of the energy and environmental costs of vertical and indoor farming. He argues artificial lighting cannot compete with sunlight in fields or greenhouses.

Neuroscientist Anil Seth gives a Royal Institution lecture on the science of consciousness. He separates conscious level, content and self, and argues that experience arises from the brain's predictive inference.

Sebastien Bubeck presents the Sparks of AGI paper at MIT, showing early experiments with GPT-4 across many domains and asking whether artificial intelligence has arrived. It includes the TikZ unicorn example.

Sean Carroll gives a Royal Institution talk tracing the history of quantum mechanics from Einstein and Bohr to today. He covers the Copenhagen interpretation and the many worlds interpretation.

The preface to Herb Gross's MIT OpenCourseWare 'Calculus Revisited: Single Variable Calculus', an older black-and-white lecture series. It introduces his approach to teaching calculus from the basics.