information processing

The first lecture of David MacKay's Cambridge course on information theory, pattern recognition and neural networks. It introduces the core ideas of his book Information Theory, Inference, and Learning Algorithms.

A PBS Space Time episode asking whether the universe's information can ever truly be lost, tying quantum mechanics, determinism and black holes together. It sets up the black hole information paradox.

Technology Connections explains why the superheterodyne radio has its name and how mixing frequencies lets it tune stations well. It walks through the underlying wave phenomena and algebra and why the design solved a hard tuning problem.

PBS Space Time episode on the black hole information paradox, covering how black holes seem to destroy information, the no-hair conjecture and the proposed role of the event horizon. It is part of a series on black holes.

3Blue1Brown's animated visual introduction to the Fourier Transform, showing how a signal breaks into frequency components.

3Blue1Brown shows how the uncertainty principle arises from Fourier transforms. A wave packet cannot be narrow in both position and frequency, so the principle is a property of waves rather than of measurement.

A New York Times Opinion documentary tracing Soviet and KGB disinformation, from the 1980s AIDS origin hoax to modern campaigns like Pizzagate. It features former KGB officers and the people who tried to counter the lies.

Destin Sandlin of Smarter Every Day explains Multi-Domain Operations through footage from his last mission at RIMPAC 2018. He covers missile and torpedo testing and interviews military leaders about the cyber and information domains.

Daniel Dennett gives a Royal Institution talk toward a unified theory of information, tying together evolution, learning and engineering. He argues that design can arise bottom-up through small steps without a designer.

The first lecture of Stanford's Natural Language Processing with Deep Learning course, taught by Chris Manning and Richard Socher. It introduces NLP and word vectors, including SVD, skip-gram, CBOW, negative sampling and word2vec.

Daniel Schmachtenberger discusses why the information ecology is damaged and what healthy public sensemaking would take. The conversation ties this to the meaning crisis and to improving discourse.

MIT researchers show that sound can be recovered from silent video by analyzing tiny vibrations in objects such as a potato chip bag. It works even with consumer cameras by using rolling shutter.

Edward Kmett's 2013 talk at Prezi in Budapest on succinct data structures, which store data in close to the information-theoretic minimum space while supporting fast queries. It ties together the research and walks through his Haskell succinct library.

Samuel Falvo II live-codes a text preprocessor and blog engine in Forth over about an hour. It shows Forth's dictionary being snapshotted and restored in place of mutation, and how a small Forth system gets real work done.

A very short clip from the children's cartoon Arthur riffing on the line about not believing everything you read on the internet.

Monty Montgomery of Xiph.org gives real-time demonstrations of sampling, quantization, bit depth and dither using real audio equipment, including both digital analysis tools and vintage analog bench gear. It shows that sampled audio is not stair-stepped and corrects common misconceptions about digital audio.

A lecture by Richard Feynman on how computers work, using the analogy of a filing clerk that becomes progressively dumber and faster. It also covers heuristics and how computers handle data and solve problems in finite time.

The first of four short videos from Bill Hammack (engineerguy) introducing and giving the history of a 100-year-old mechanical computer, Michelson's harmonic analyzer. The series goes on to explain Fourier synthesis, analysis and operation of the machine.

Mike Pound explains the discrete cosine transform and how it underpins JPEG compression. It is part two of Computerphile's JPEG series.

David Kriesel's 31C3 talk, in German, on the discovery that Xerox scanner-copiers silently replace digits and letters in scanned documents. He explains how the bug stayed unnoticed in the wild for years.

Tom Scott explains for Computerphile how Unicode and UTF-8 grew out of messy older character encodings to become the web's standard. It covers why the design works and how it handles worldwide text.

Stanford physicist Leonard Susskind gives a public lecture on the holographic principle, the indestructibility of information and the nature of black holes. It asks whether the world could be a hologram.

3Blue1Brown introduces Fourier series, from the heat equation to drawing arbitrary shapes with rotating circles. It builds a visual intuition for decomposing functions into sine waves.

A Royal Institution event with Sean Carroll and Jennifer Ouellette on what happens if you fall into a black hole, covering the firewall paradox, the information problem and the holographic principle.

Tom Scott explains why confetti and snow wreck video quality, using interframe compression and bitrate. He demonstrates it live by changing the quality on screen.

A long information session where The Boring Company presents its vision for Loop, an underground high-speed transit system, and the traffic problems it aims to solve. It includes discussion of faster tunnel boring and electrification.

Timur Doumler's CppCon 2015 talk on how C++ is used in the audio industry. It covers the patterns and tools audio developers rely on, including handling real-time constraints.

A Justin Bieber song slowed down 800% with the PaulStretch program, turning a pop track into a long ambient drone.

Course outline for Stanford's online GNSS course, introducing how GPS works and the many uses of satellite navigation. The series pairs short lectures with backyard experiments using smartphones.

Onslaught's Bad Apple 64 is a Commodore 64 demo that streams over 2000 frames of the Bad Apple animation from a single disk side at 12fps, with each frame packed to around 70 bytes.

Tom Scott explains for Computerphile how floating point numbers work, why moving the binary point is fast, and why it handles money badly.

David Kriesel's FrOSCon talk on how Xerox scancopiers, due to JBIG2 compression, silently replaced digits in scanned documents. He walks through how he discovered the bug and why it is so dangerous.

Tom Scott explains why hold music sounds worse than it used to, tracing it to old telephone exchanges and the audio compression applied by modern switches. It is a short visit to the Milton Keynes Museum.

Mathologer explains epicycles and complex Fourier series, inspired by an animation of Homer Simpson drawn with epicycles. It covers the shape of the Moon's orbit around the Sun and how to make your own epicycle drawings.

A spectrogram visualization of the sounds in a dial-up modem handshake, with an annotated image explaining each noise. It shows how the handshake's tones map to the negotiation steps.

A short clip of Venetian Snares' track 'Look' from Songs About My Cats (2001), shown as a spectrogram. The audio encodes an image in its frequency content.

A King of the Hill clip in which Hank-style character rants about saving images as PNG instead of JPEG after exporting from Windows Paint.

A condensed rendition of a project that re-uploaded one video to YouTube 1000 times, showing the accumulating compression artifacts. It pays homage to Alvin Lucier's I Am Sitting in a Room.

A short demonstration of radioteletype (RTTY), a digital communication mode used in amateur radio, showing what the signal sounds like.

A six-minute clip of Adobe's MAX 2011 sneak peek showing a Photoshop prototype that removes motion blur from photos. The audience reacts with astonishment as blurry images become legible.