language

A short cartoon explaining how language models like ChatGPT work, from autocomplete and conditional probabilities to neural networks, gradient descent and backpropagation. It shows how networks act as universal function approximators.

Tom Scott, with linguists Gretchen McCulloch and Molly Ruhl, examines whether the language you speak changes how you think. The short answer is mostly no, with caveats about the weak version of the Sapir-Whorf hypothesis.

Rob Miles discusses GPT-3 on Computerphile, covering how scaling parameters kept improving results over GPT-2 and how the model nearly learned arithmetic without anyone knowing exactly how.

The Map Men explain why British place names are so hard to pronounce, tracing it to layers of Viking, Anglo-Saxon, Celtic and Norman influence, with a pronunciation guide.

Aaron Francis walks through how PHP has changed from 2012 to 2023, covering traits, array destructuring, generators, typed properties and more. It is a quick chaptered tour of modern PHP features.

3Blue1Brown's visual explanation of how transformers and GPT-style language models work, tracing data through tokens, embeddings and attention.

Linguist Simon Roper reconstructs how a London accent would have sounded from the 14th to the 21st centuries, reading passages in period pronunciation. It draws on the Cambridge History of the English Language.

Tom Scott explains why subtitles often differ from dubbed dialogue, covering how translation, timing and reading speed shape each. It features translators and voice talent working in several languages.

Computerphile video in which Mike Pound explains a University of Maryland paper on watermarking LLM output. The method biases token choices so generated text can later be detected statistically.

Dialect coach Erik Singer tours a range of accents across North America with linguists in Part 2 of WIRED's accent series. It covers regional distinctions such as Southern Mississippi, Miami and Utah English.

Linguist Geoff Lindsey explores vocal fry: what it is, who uses it, how it relates to glottal stops and accents, and why some people dislike it.

Dialect coach Erik Singer and several linguists tour distinct accents across English-speaking North America. It is the first part of a WIRED series on US accents.

CGP Grey explains why airport codes are inconsistent and sometimes confusing, from their origins in old weather station codes to the quirks that cause mistakes. He builds the story around a single typo that sent a flight to the wrong continent.

CGP Grey investigates why the name Tiffany spiked in popularity and then faded, with help from onomastics experts. It is a short, playful look at how names spread.

Tom Scott explains Gricean maxims, the unwritten guidelines that shape how we understand each other. He uses examples such as why 'asbestos-free cereal' sounds suspicious.

Rob Miles explains "glitch" tokens, odd strings in large language model vocabularies that make the model produce gibberish. He covers how they likely arise from tokenizer training data, such as Reddit usernames, that never appeared in the model's own training.

Huygens Optics explains the Fourier transform and shows how a lens performs one optically. A DLP projector is used as a Fourier filter to do simple pattern recognition on lithographic character patterns.

Benn Jordan explains how Flock Safety's license plate cameras log and share vehicle locations, and explores how adversarial AI can defeat them. It covers weak security and the surveillance risks of private police-camera networks.

3Blue1Brown's visual walkthrough of the attention mechanism inside transformers, covering self-attention, multiple heads and cross-attention. It is chapter 6 of his deep learning series.

A Computerphile video in which Dr Mike Pound and PhD student Lewis Stuart explain 3D Gaussian splatting, a quick technique that turns photos of a scene into a 3D model without much compute. It includes a demo and compares the approach to NeRFs.

Kurzgesagt examines how AI-generated content is flooding the internet, from video and music to news and books. It looks at how this makes verifying what is real harder.

Alex O'Connor shows that ChatGPT cannot draw a wine glass filled to the brim, and ties the failure to David Hume's missing shade of blue. It asks what the failure says about how image models learn.

A Welch Labs explainer on neural scaling laws and the compute-efficient frontier, asking why model loss seems to hit a line it cannot cross. It draws an analogy to an ideal gas law for AI.

Musician Benn Jordan explains and demonstrates adversarial noise that poison-pills music files against AI training and scraping.

Chubbyemu presents a case study of a man who followed AI health advice, replaced salt with sodium bromide and developed bromism with severe neurological effects. It is told as a dramatized medical case by a doctor.

Musician Benn Jordan uses AI to detect AI-generated music and digs into music industry data, including streaming payouts and sample library copyright problems. He covers ways to tell whether a track is human-made.

A guest video by Welch Labs on 3Blue1Brown explaining how text-to-image and video models work. It covers CLIP, shared embedding spaces, diffusion models (DDPM, DDIM), conditioning, guidance and negative prompts.

Steve Mould explains motion amplification and video magnification, techniques that find tiny changes in video invisible to the eye and exaggerate them. He covers the MIT research and industrial uses such as diagnosing vibrating machinery.

FortNine looks at why Tesla Autopilot has rear-ended motorcyclists, speculating that the vision system misreads motorcycle taillights as a distant car. It argues that radar and other sensors would help.

An animated introduction to geometric algebra, presented as a language that can describe most of physics. It was made with manim and covers multivectors and how they generalize familiar tools like cross products and quaternions.

A Veritasium video on how a feud between Russian mathematicians led to Markov chains and the modern prediction algorithms built on them. It covers the history and the math behind them.

Geekerwan's Chinese-language review of Intel's Lunar Lake lightweight laptop chip, covering performance, perf-per-watt curves and battery life benchmarks. It tests whether x86 can compete on efficiency.