coded language

Rob Miles explains on Computerphile how language models generate plausible text and how transformers improved on recurrent networks, with a look at what comes next.

Rob Miles discusses GPT-3 on Computerphile, covering how scaling parameters kept improving results over GPT-2 and how the model nearly learned arithmetic without anyone knowing exactly how.

3Blue1Brown's visual explanation of how transformers and GPT-style language models work, tracing data through tokens, embeddings and attention.

An animated introduction to geometric algebra, presented as a language that can describe most of physics. It was made with manim and covers multivectors and how they generalize familiar tools like cross products and quaternions.

Benn Jordan's video about storing a PNG image in a living bird, a starling that learns to reproduce encoded sounds. It mixes ornithology, audio engineering, and data encoding.

A Veritasium video on how a feud between Russian mathematicians led to Markov chains and the modern prediction algorithms built on them. It covers the history and the math behind them.

Geekerwan's Chinese-language review of Intel's Lunar Lake lightweight laptop chip, covering performance, perf-per-watt curves and battery life benchmarks. It tests whether x86 can compete on efficiency.