distributed training

Yosh trains a reinforcement learning agent to drive Trackmania until he can no longer beat it. The video explains how the training works and the design choices involved.

Rick Beato argues that adults cannot develop true perfect pitch, which he ties to critical-period brain plasticity and language acquisition. He says it can only be developed in young children, and discusses the research behind this.

Robert Miles explains reward modelling, in which an AI learns what humans want from their preference comparisons instead of a hand-written reward function. He walks through the 2017 paper on deep reinforcement learning from human preferences.

FortNine's tongue-in-cheek guide to why drivers fail to see motorcyclists and how riders can make themselves more visible. It touches on perception psychology, including the role of saccades.

Alex O'Connor shows that ChatGPT cannot draw a wine glass filled to the brim, and ties the failure to David Hume's missing shade of blue. It asks what the failure says about how image models learn.

Adam Neely explains what perfect (absolute) pitch is, how it differs from relative and quasi-absolute pitch, and why he would not want it. He covers its drawbacks, including drift with age.

Practical Engineering explains why connecting solar and other inverter-based generation to the grid is hard. It covers grid stability, load balancing and the behind-the-scenes engineering challenges of renewables.

3Blue1Brown's second neural network chapter explains cost functions and gradient descent, showing how a network learns by minimizing error during training.

Rob Miles explains "glitch" tokens, odd strings in large language model vocabularies that make the model produce gibberish. He covers how they likely arise from tokenizer training data, such as Reddit usernames, that never appeared in the model's own training.

Musician Benn Jordan explains and demonstrates adversarial noise that poison-pills music files against AI training and scraping.

A 1951 Bell System training film showing how telephone calls are routed through a step-by-step (Strowger) switching office.

Robert Miles covers a paper where researchers ran real versions of his earlier mesa-optimizer thought experiments. They show inner misalignment, where an AI learns the wrong goal in training and misbehaves when deployed.

Practical Engineering explains how continuous welded rail copes with thermal expansion by restraining it, using the relationship between temperature, stress and strain. The video is part of a series on railways.

A SAAMI-produced training video for firefighters explaining what happens when sporting ammunition burns, including that unchambered cartridges lack the energy to penetrate much. It includes test footage of ammunition in fires.