compression

Ilya Sutskever gives a Simons Institute talk on why neural networks generalize, framing learning as finding short descriptions, like compression. It was part of the Large Language Models and Transformers program.

Lex Fridman interviews Marcus Hutter of DeepMind about universal artificial intelligence, AIXI, Kolmogorov complexity, Solomonoff induction and the idea of intelligence as compression.

A short side-by-side demo of a large image loading over a slow connection in JPEG, progressive mozjpeg, JPEG XL and AVIF. It shows how each codec renders partial data.

Reducible's visual walkthrough of the Fast Fourier Transform, motivated by polynomial multiplication. It shows how the FFT's key ideas can be discovered by asking the right questions.

Huygens Optics explains the Fourier transform and shows how a lens performs one optically. A DLP projector is used as a Fourier filter to do simple pattern recognition on lithographic character patterns.

3Blue1Brown's discovery-oriented introduction to error correction codes, building up Hamming codes from the puzzle of locating a flipped bit. It explains the parity-check idea and why it is so efficient.

Veritasium tells the story of the Fast Fourier Transform, from its use in detecting nuclear tests to Cold War politics, and how it could have changed the arms race. It includes a short, intuitive explanation of what the Fourier transform does.

3Blue1Brown uses Wordle as an excuse to teach information theory and entropy, building a solver that picks guesses by expected information and incorporating word frequencies.

Dan Worrall explains when higher sample rates help in recording and mixing, and when they do not. He goes into oversampling versus higher sample rates, and aliasing in distortion plugins.

A 105-minute technical deep dive from Noise In Space evaluating whether Starlink satellites could work as synthetic aperture radar. It covers SAR signal-to-noise, amplifiers, antennas, duplexing, phased array beamforming and simulations of V2 Mini and V3 satellites.

GoldenSound publishes music on Tidal to test MQA, a deep dive into the format's claims and problems including its leaky filter. Testing begins around the 5:45 mark.

Veritasium builds a QR code by hand to explain how it works. It covers the history of Morse code and barcodes, how QR codes encode data, why damaged codes still scan, and how safe they are.

Brian Karis's SIGGRAPH 2021 talk explains how Unreal Engine 5's Nanite virtualized geometry works. It covers mesh import, the data structures, streaming, decompression, culling, software and hardware rasterization, and shading.

In Ars Technica's War Stories, Naughty Dog co-founder Andy Gavin explains how the team squeezed Crash Bandicoot onto the original PlayStation. They overwrote Sony library code in RAM, built custom animation compression, and streamed assets around slow seek times.

A step-by-step animated explanation of how SHA-256 works, from padding and message schedule to the compression function and final hash, with source code for the animations.

Musician Benn Jordan uses AI to detect AI-generated music and digs into music industry data, including streaming payouts and sample library copyright problems. He covers ways to tell whether a track is human-made.