image processing

A guest video by Welch Labs on 3Blue1Brown explaining how text-to-image and video models work. It covers CLIP, shared embedding spaces, diffusion models (DDPM, DDIM), conditioning, guidance and negative prompts.

Alex O'Connor shows that ChatGPT cannot draw a wine glass filled to the brim, and ties the failure to David Hume's missing shade of blue. It asks what the failure says about how image models learn.

Benn Jordan's video about storing a PNG image in a living bird, a starling that learns to reproduce encoded sounds. It mixes ornithology, audio engineering, and data encoding.

Veritasium visits the US Navy's Crane facility to test top night vision goggles. It explains how image intensifier tubes and thermal or digital systems work and compares the generations of the technology.

A short Techquickie explainer on why laptop webcams are much worse than phone cameras. It covers sensor size, image processing, and the interface differences between laptops and phones, with input from a Logitech engineer.

Huygens Optics explains the Fourier transform and shows how a lens performs one optically. A DLP projector is used as a Fourier filter to do simple pattern recognition on lithographic character patterns.

Benn Jordan explains how Flock Safety's license plate cameras log and share vehicle locations, and explores how adversarial AI can defeat them. It covers weak security and the surveillance risks of private police-camera networks.

A Computerphile video in which Dr Mike Pound and PhD student Lewis Stuart explain 3D Gaussian splatting, a quick technique that turns photos of a scene into a 3D model without much compute. It includes a demo and compares the approach to NeRFs.

Rob Miles explains "glitch" tokens, odd strings in large language model vocabularies that make the model produce gibberish. He covers how they likely arise from tokenizer training data, such as Reddit usernames, that never appeared in the model's own training.

Steve Mould explains motion amplification and video magnification, techniques that find tiny changes in video invisible to the eye and exaggerate them. He covers the MIT research and industrial uses such as diagnosing vibrating machinery.

FortNine looks at why Tesla Autopilot has rear-ended motorcyclists, speculating that the vision system misreads motorcycle taillights as a distant car. It argues that radar and other sensors would help.

Reducible's visual walkthrough of the Fast Fourier Transform, motivated by polynomial multiplication. It shows how the FFT's key ideas can be discovered by asking the right questions.

Veritasium tells the story of the Fast Fourier Transform, from its use in detecting nuclear tests to Cold War politics, and how it could have changed the arms race. It includes a short, intuitive explanation of what the Fourier transform does.

Explains the proposed NASA JPL plan to use the Sun as a gravitational lens, sending solar sail craft to its focal region to image an exoplanet's surface. It covers the distances involved, how imaging with the Sun would work and the mission design.

PBS Space Time explains the proposal to use the Sun's gravity as a giant lens, sending a train of small light-sail spacecraft to the focal point roughly 550 AU out. It covers how such a telescope could image exoplanets in surprising detail and the engineering challenges involved.

Wes Bos breaks down the techniques behind the McMaster-Carr website's speed: server-rendered HTML, prefetching, CDN and service worker caching, preloading, critical CSS and fixed-size images. He also notes its old-school jQuery and YUI JavaScript.

Retro Game Mechanics Explained shows how the Atari 2600 draws images with almost no video memory, by having the CPU race the CRT beam line by line. It walks through the techniques in detail.

Technology Connections takes apart the step-by-step electromechanical logic of a 1970s pinball machine. He shows how relays, steppers and switches track state and score without electronics.