fourier transform

3Blue1Brown's animated visual introduction to the Fourier Transform, showing how a signal breaks into frequency components.

3Blue1Brown shows how the uncertainty principle arises from Fourier transforms. A wave packet cannot be narrow in both position and frequency, so the principle is a property of waves rather than of measurement.

Reducible's visual walkthrough of the Fast Fourier Transform, motivated by polynomial multiplication. It shows how the FFT's key ideas can be discovered by asking the right questions.

Huygens Optics explains the Fourier transform and shows how a lens performs one optically. A DLP projector is used as a Fourier filter to do simple pattern recognition on lithographic character patterns.

Veritasium tells the story of the Fast Fourier Transform, from its use in detecting nuclear tests to Cold War politics, and how it could have changed the arms race. It includes a short, intuitive explanation of what the Fourier transform does.

3Blue1Brown introduces Fourier series, from the heat equation to drawing arbitrary shapes with rotating circles. It builds a visual intuition for decomposing functions into sine waves.

Mathologer explains epicycles and complex Fourier series, inspired by an animation of Homer Simpson drawn with epicycles. It covers the shape of the Moon's orbit around the Sun and how to make your own epicycle drawings.

3Blue1Brown's visual explanation of how transformers and GPT-style language models work, tracing data through tokens, embeddings and attention.

3Blue1Brown's visual walkthrough of the attention mechanism inside transformers, covering self-attention, multiple heads and cross-attention. It is chapter 6 of his deep learning series.

Leo Dirac explains how transformer models have replaced LSTMs in NLP. He gives background from bag of words through RNNs and LSTMs, then a technical deep dive into multi-headed self-attention and positional encoding, with sample code.

Rob Miles explains on Computerphile how language models generate plausible text and how transformers improved on recurrent networks, with a look at what comes next.

The first of four short videos from Bill Hammack (engineerguy) introducing and giving the history of a 100-year-old mechanical computer, Michelson's harmonic analyzer. The series goes on to explain Fourier synthesis, analysis and operation of the machine.

Mike Pound explains the discrete cosine transform and how it underpins JPEG compression. It is part two of Computerphile's JPEG series.

A university lecture from CS480/680 by Pascal Poupart on attention mechanisms and transformer networks, worked through on a chalkboard.

A short animation reconstructing a planet's looping orbit using Ptolemy's epicycles and deferents, with the epicycles tracing out the face of Homer Simpson. It shows how enough circles can reproduce nearly any shape.

A tour of Christian Schallert's 24 square meter apartment in Barcelona, designed so that it looks like an empty cube until he builds the furniture he needs. Kirsten Dirksen shows how the space is transformed for cooking, sleeping and dressing.

Yannic Kilcher walks through the Attention Is All You Need paper, which introduced the Transformer, a sequence model based solely on attention without recurrence or convolutions. He reviews the architecture and the paper's translation results.

Kirsten Dirksen visits architect Gary Chang's 32 square meter Hong Kong apartment, which he has redesigned over decades. Sliding walls and transformable furniture turn it into 24 different room configurations.

Andrej Karpathy builds a GPT from scratch in code, following Attention Is All You Need and GPT-2/3, in about two hours using PyTorch. He connects it to ChatGPT and assumes familiarity with his earlier makemore videos.

Raymond Hettinger's PyCon 2013 talk on transforming code into idiomatic Python through a series of before-and-after refactorings. It shows how to use iterators, dictionaries, named tuples and other language features well.

Lex Fridman's long conversation with Andrej Karpathy on Tesla's self-driving approach, Optimus, neural networks, transformers, AGI and more. It also touches on his OpenAI work and working with Elon Musk.

A 3Blue1Brown live lockdown math episode asking what Euler's formula e^(pi i) is actually saying. It builds intuition through exponentials, rotation and vectors landing on the unit circle.

Ilya Sutskever gives a Simons Institute talk on why neural networks generalize, framing learning as finding short descriptions, like compression. It was part of the Large Language Models and Transformers program.

Martin Kleppmann's GOTO Berlin 2016 talk on how collaborative editors, offline apps, and multi-datacenter databases handle concurrent updates. It covers conflict resolution approaches including operational transformation and CRDTs, with a worked look at text CRDTs.

A 10-minute 3Blue1Brown chapter explaining the determinant as the factor by which a linear transformation scales area or volume. It builds the idea geometrically with animations before any formulas.

Rhonda Patrick interviews Dr. Bill Harris, co-inventor of the Omega-3 Index and author of more than 300 papers on fatty acids. They cover EPA and DHA dosing, fish oil studies such as REDUCE-IT, and how omega-3 levels relate to health and longevity.

Ian Hubert shows how to use Blender's motion tracking to turn ordinary footage of a room into a stylized digital environment for an indie film. It is a quick, practical walkthrough in his loose, lazy-tutorial style.

Neil Fraser of Google presents Differential Synchronization, the algorithm behind MobWrite, for keeping multiple copies of a document in sync in real time. The talk argues the approach is robust, convergent and efficient.

Jon Bentley walks through three implementations of Hoare's Quicksort, from a dozen-line C function to a series of systematic code transformations that make the program ever simpler and more powerful. It is a Google Tech Talk on code elegance and program derivation.

BigClive explains why microwave oven transformer projects are extremely dangerous, since the high voltage and high current can kill. He contrasts them with spot welder builds where the secondary is replaced by low-voltage heavy wire.

A 2019 BBC News report by John Sudworth, who was given rare access to the secure facilities in Xinjiang where more than a million Muslims are thought to be held. Authorities call them training schools, and the report examines what the visit reveals about the system and conditions inside.

Dwarkesh Patel interviews Google's Jeff Dean and Noam Shazeer about 25 years at the company, from PageRank and MapReduce to the Transformer, mixture of experts and Gemini. They also discuss where AI is heading.

Tesla's 2021 AI Day presentation covering vision, planning and control, auto-labeling, simulation, the Dojo training hardware and the Tesla Bot announcement, followed by a Q&A.

Monty Montgomery of Xiph.org gives real-time demonstrations of sampling, quantization, bit depth and dither using real audio equipment, including both digital analysis tools and vintage analog bench gear. It shows that sampled audio is not stair-stepped and corrects common misconceptions about digital audio.

David Kriesel's 31C3 talk, in German, on the discovery that Xerox scanner-copiers silently replace digits and letters in scanned documents. He explains how the bug stayed unnoticed in the wild for years.

Tom Scott explains for Computerphile how Unicode and UTF-8 grew out of messy older character encodings to become the web's standard. It covers why the design works and how it handles worldwide text.

David MacKay's 2007 Google Tech Talk presents Dasher, a text-entry system driven by continuous gestures and a language model, reaching about 35 words per minute with one finger and 25 hands-free. It explains the information-theory reasoning behind the design.

3Blue1Brown's discovery-oriented introduction to error correction codes, building up Hamming codes from the puzzle of locating a flipped bit. It explains the parity-check idea and why it is so efficient.

Technology Connections explains why the superheterodyne radio has its name and how mixing frequencies lets it tune stations well. It walks through the underlying wave phenomena and algebra and why the design solved a hard tuning problem.

Tom Scott explains why confetti and snow wreck video quality, using interframe compression and bitrate. He demonstrates it live by changing the quality on screen.