language

Rob Miles explains on Computerphile how language models generate plausible text and how transformers improved on recurrent networks, with a look at what comes next.

A short cartoon explaining how language models like ChatGPT work, from autocomplete and conditional probabilities to neural networks, gradient descent and backpropagation. It shows how networks act as universal function approximators.

Tom Scott, with linguists Gretchen McCulloch and Molly Ruhl, examines whether the language you speak changes how you think. The short answer is mostly no, with caveats about the weak version of the Sapir-Whorf hypothesis.

Rob Miles discusses GPT-3 on Computerphile, covering how scaling parameters kept improving results over GPT-2 and how the model nearly learned arithmetic without anyone knowing exactly how.

Vox explains the Berlin and Kay research showing that languages around the world tend to invent color words in the same order. It walks through the hierarchy and the debate around it.

Tom Scott makes a short descriptivist argument that language keeps changing and that casual internet writing conventions, like lowercase typing and dropped full stops, are legitimate. It is part of his Language Files series, written with Gretchen McCulloch.

Yuta asks whether native Japanese speakers can actually write kanji by hand, showing that many struggle to recall characters from memory.

The Map Men explain why British place names are so hard to pronounce, tracing it to layers of Viking, Anglo-Saxon, Celtic and Norman influence, with a pronunciation guide.

Aaron Francis walks through how PHP has changed from 2012 to 2023, covering traits, array destructuring, generators, typed properties and more. It is a quick chaptered tour of modern PHP features.

3Blue1Brown's visual explanation of how transformers and GPT-style language models work, tracing data through tokens, embeddings and attention.

Linguist Simon Roper reconstructs how a London accent would have sounded from the 14th to the 21st centuries, reading passages in period pronunciation. It draws on the Cambridge History of the English Language.

Yuta, a Japanese YouTuber, explains whether Japanese speakers can read Chinese text. He shows how shared kanji let people guess meanings while the two languages remain completely different.

Tom Scott explains why subtitles often differ from dubbed dialogue, covering how translation, timing and reading speed shape each. It features translators and voice talent working in several languages.

Computerphile video in which Mike Pound explains a University of Maryland paper on watermarking LLM output. The method biases token choices so generated text can later be detected statistically.

Tom Scott explains for Computerphile why handling time and timezones in code is so hard, walking through a simple web app that computes how long ago something happened. It covers the quirks of timezones and calendars and ends in an exasperated rant.

CGP Grey explains why "Indian" is often preferred over "Native American" in the United States, especially near reservations, and how many tribes exist in the US. He draws on conversations with people who identify as Indian.

Vsauce's explainer on Zipf's law, the pattern in which the frequency of a word is inversely related to its rank. It shows the pattern across many domains and discusses why it remains unexplained.

Tom Scott-style exploration by suckerpinch (Tom7) of generalized anagrams where letters can be broken into pieces, called anagraphs, with a whimsical computational approach.

Vox breaks down how great rappers build rhymes, from Kurtis Blow's simple bars to Biggie's smooth flow and Kendrick Lamar's dense, fast delivery. It uses on-screen visualizations of rhyme structure.

Tom Scott argues that grammatical gender is a silly concept and that the singular 'they' is an established gender-neutral pronoun. The description carries later corrections and reflections he added in 2019.

David and Ben Crystal introduce the Original Pronunciation production of Shakespeare and show what it reveals about the history of English, including puns and rhymes lost in modern speech.

jan Misali traces the history of the letter W, including why it is called double u. The video is part of a series of deep dives into individual letters.

Dialect coach Erik Singer tours a range of accents across North America with linguists in Part 2 of WIRED's accent series. It covers regional distinctions such as Southern Mississippi, Miami and Utah English.

Linguist Geoff Lindsey explores vocal fry: what it is, who uses it, how it relates to glottal stops and accents, and why some people dislike it.

Tom Scott explains phatic expressions such as hello, thank you and how are you, which carry social meaning rather than information, and why replies like no problem can seem rude to some people.

A re-upload of a video breaking down Eminem's rhyme schemes, showing multi-syllable and internal rhymes in songs such as Lose Yourself. It aims to show why he is considered a standout lyricist.

Dialect coach Erik Singer and several linguists tour distinct accents across English-speaking North America. It is the first part of a WIRED series on US accents.

CGP Grey explains why airport codes are inconsistent and sometimes confusing, from their origins in old weather station codes to the quirks that cause mistakes. He builds the story around a single typo that sent a flight to the wrong continent.

CGP Grey investigates why the name Tiffany spiked in popularity and then faded, with help from onomastics experts. It is a short, playful look at how names spread.

Numberphile explains the long and short scales for naming large numbers, covering millions, billions, trillions, milliards and the Greek myriad, with James Grime and Tony Padilla.

Tom Scott explains Gricean maxims, the unwritten guidelines that shape how we understand each other. He uses examples such as why 'asbestos-free cereal' sounds suspicious.

Dialect coach Erik Singer analyzes how accurate the accents are of 32 well-known actors, including Brad Pitt and Will Smith, in WIRED's breakdown.

A Langfocus video examining why Portuguese, especially European Portuguese, sounds like Russian or Polish. It compares shared sounds such as vowel reduction and palatalization.

Rob Miles explains "glitch" tokens, odd strings in large language model vocabularies that make the model produce gibberish. He covers how they likely arise from tokenizer training data, such as Reddit usernames, that never appeared in the model's own training.

Mike Pound explains the discrete cosine transform and how it underpins JPEG compression. It is part two of Computerphile's JPEG series.

Huygens Optics explains the Fourier transform and shows how a lens performs one optically. A DLP projector is used as a Fourier filter to do simple pattern recognition on lithographic character patterns.

Benn Jordan explains how Flock Safety's license plate cameras log and share vehicle locations, and explores how adversarial AI can defeat them. It covers weak security and the surveillance risks of private police-camera networks.

3Blue1Brown's visual walkthrough of the attention mechanism inside transformers, covering self-attention, multiple heads and cross-attention. It is chapter 6 of his deep learning series.

Yannic Kilcher walks through the Attention Is All You Need paper, which introduced the Transformer, a sequence model based solely on attention without recurrence or convolutions. He reviews the architecture and the paper's translation results.

A Computerphile video in which Dr Mike Pound and PhD student Lewis Stuart explain 3D Gaussian splatting, a quick technique that turns photos of a scene into a 3D model without much compute. It includes a demo and compares the approach to NeRFs.