alignment

Robert Miles covers a paper where researchers ran real versions of his earlier mesa-optimizer thought experiments. They show inner misalignment, where an AI learns the wrong goal in training and misbehaves when deployed.

Robert Miles gives a remastered introduction to AI safety, adapted from a talk in London. It lays out why advanced AI could go wrong and answers common objections.

Robert Miles explains the orthogonality thesis: how an agent can be highly intelligent while pursuing goals that seem stupid or alien to humans. He separates intelligence from goals and touches on the stamp-collector example.

A Computerphile video in which Rob Miles warns against assuming a general AI will think like a human. He uses the thought experiment of a stamp-collecting AI to show how a goal-driven system could pursue its aim with dangerous results.

Robert Miles introduces the first of several videos on the paper 'Concrete Problems in AI Safety', focusing on how AI systems can cause accidental negative side effects. It explains the problem in accessible terms.

Rob Miles explains for Computerphile why simple rule sets like Asimov's Three Laws cannot make robots and AI safe. Terms like harm and human are too ambiguous to specify precisely.

Robert Miles goes through ten common reasons people give for dismissing AI safety, adapted from Stuart Russell's list, and answers each one. It is aimed at skeptics and newcomers.

A speculative-fiction video by Tom Scott, framed as coming from a future, about an AI called Earworm that enforces copyright so aggressively that humanity ends up forgetting a century of pop culture. It is animated and narrated as part of his series of videos from a future.

CGP Grey's video "Humans Need Not Apply" argues that automation will make a large part of the workforce economically obsolete, much as engines did for horses. It surveys robots and software replacing both physical and mental labor.

Robert Miles explains instrumental convergence: why an AGI with almost any goal would tend to pursue sub-goals like self-preservation and resource acquisition. It builds on Omohundro's basic AI drives and his orthogonality thesis video.

Robert Miles asks whether corporations can be thought of as artificial general superintelligences and how far the analogy holds. He argues the differences, such as being limited by employees' capabilities, matter for AI safety.

Slaughterbots is a fictional short film, backed by Stuart Russell, depicting swarms of cheap autonomous drones that use facial recognition to assassinate targets. It was made to argue for banning autonomous weapons.

Robert Miles examines whether the case for AI safety is a Pascal's mugging, a tiny probability of an enormous payoff. He argues it is not, because AI risk does not depend on vanishingly small probabilities.

Slaughterbots is a short sci-fi film in which swarms of cheap autonomous drones are programmed to kill targets by profile. It was made as arms-control advocacy against autonomous weapons.

Robert Miles explains reward modelling, in which an AI learns what humans want from their preference comparisons instead of a hand-written reward function. He walks through the 2017 paper on deep reinforcement learning from human preferences.

Yannic Kilcher explains how he trained a language model on three years of 4chan's /pol/ board and let it post on the site. He evaluates how good the model was and discusses the ethics and fallout.

Novelist Daniel Suarez warns in a TED talk about autonomous robotic weapons and drones. He argues that taking the decision to kill out of human hands threatens democratic accountability and calls for a ban.

Tom Scott describes trying ChatGPT to fix his Gmail labels and being unsettled by how capable it was. He argues that we cannot know where we are on the technology curve, comparing it to Napster.

Bloomberg Technology interviews Google engineer Blake Lemoine about the experiments that led him to believe LaMDA was sentient and why he was placed on administrative leave. He also raises concerns about AI ethics at Google.

Brandon Sanderson's keynote on AI-generated art, arguing that the artistic process and the journey matter more than the finished product. He explains why he rebels against generative AI in creative work.

An 8-minute fictional short film, made by campaigners for a ban on autonomous weapons, depicting swarms of cheap AI-guided micro-drones used to kill targeted people. It ends with a call to action against autonomous weapons.

Last Day of War is an award-winning CGI animated short by Dima Fedotov in which automated machines keep following orders and prepare a bomber after all humans are dead.

Sal Khan of Khan Academy gives a TED talk on how AI could transform education, with a personal tutor for every student and a teaching assistant for every teacher. He demos Khanmigo, including features where the AI reasons before responding.

Sam Harris argues in a TED talk that we will build superhuman AI and have not grappled with the risk of creating something that may treat us the way we treat ants. He makes a logical case for taking AI risk seriously.

A Kurzgesagt animation on longtermism, arguing that because the future could hold trillions of people, our actions' effect on future generations may be what matters most.

A dramatized fictional video of micro drones with facial recognition and swarm AI used as autonomous killer weapons. It is a Slaughterbots-style warning about lethal autonomous weapons.

Demis Hassabis of DeepMind speaks at Google Zeitgeist, saying human-level AI is decades away but the debate should start now. He covers DeepMind's focus on game-playing agents.

Jon Stewart on The Daily Show satirizes the AI industry's promises of a better future while it builds technology to replace workers. It mocks executives and AI hype.

Slaughterbots, a short dystopian film in which swarms of small autonomous drones are programmed to kill targets matching a profile. It opens as a slick product launch before turning into a terror scenario.

A short pre-recorded talk by Rich Sutton for the World AI Conference in Shanghai arguing that succession from humanity to AI is inevitable. He lays out his view of that transition.