robert lustig

Robert Miles introduces the first of several videos on the paper 'Concrete Problems in AI Safety', focusing on how AI systems can cause accidental negative side effects. It explains the problem in accessible terms.

Robert Miles explains instrumental convergence: why an AGI with almost any goal would tend to pursue sub-goals like self-preservation and resource acquisition. It builds on Omohundro's basic AI drives and his orthogonality thesis video.

Robert Miles explains the orthogonality thesis: how an agent can be highly intelligent while pursuing goals that seem stupid or alien to humans. He separates intelligence from goals and touches on the stamp-collector example.

Robert Miles asks whether corporations can be thought of as artificial general superintelligences and how far the analogy holds. He argues the differences, such as being limited by employees' capabilities, matter for AI safety.

Robert Miles examines whether the case for AI safety is a Pascal's mugging, a tiny probability of an enormous payoff. He argues it is not, because AI risk does not depend on vanishingly small probabilities.

Robert Miles goes through ten common reasons people give for dismissing AI safety, adapted from Stuart Russell's list, and answers each one. It is aimed at skeptics and newcomers.

Robert Miles explains reward modelling, in which an AI learns what humans want from their preference comparisons instead of a hand-written reward function. He walks through the 2017 paper on deep reinforcement learning from human preferences.

Robert Miles covers a paper where researchers ran real versions of his earlier mesa-optimizer thought experiments. They show inner misalignment, where an AI learns the wrong goal in training and misbehaves when deployed.

The first part of Extra History's animated miniseries on the South Sea Bubble. It explains how England's government debt led Robert Harley to turn to financier John Blunt, whose schemes began inflating artificial demand for shares.

Scott Manley explains the nuclear salt water rocket, Robert Zubrin's concept of a rocket fueled by a rapid nuclear reaction in uranium salt dissolved in water. He covers its extraordinary performance and the dangers of managing it.