HackerTube
HomeLongsLikedHistoryWatch laterCategoriesPlaylistsSettings

Deadly Truth of General AI? - Computerphile

Computerphile3 HN recommenders · recommended in 3 months, 2016-2024
YouTube
941K views · 11 years ago · explainer · evergreen

A Computerphile video in which Rob Miles warns against assuming a general AI will think like a human. He uses the thought experiment of a stamp-collecting AI to show how a goal-driven system could pursue its aim with dangerous results.

Often pointed to as an accessible first introduction to AI safety and why a superintelligent AI could be dangerous.

AI safety, AGI & impact#agi#robmiles#stampcollector#superintelligence#alignment

7 comments from Hacker News

@npoc2024 · in “Bitcoin Block 840000”

That's an issue with the concept of a "black budget", not the payment mechanism. The government corruption bitcoin stops is really bank corruption, but the central banks (including the fed) work hand in hand with the governments (control them in fact), so it's a kind of joint effort. The corruption works like this: When the Fed was formed in the early 20th century, it came to an agreement with the government to be able to print off unlimited amounts of money, providing it was in the form of loans and under the agreement that it would destroy the money when the loans were repaid. All under the Keynesian guise of "elasticity of money". The fly in the ointment is that the banks can charge interest on this money they print - if they didn't it would be a free-for all, because interest is what disincentivises debt. What this led to was the doubling of the money supply every decade for the last 100 years, as the banks are incentivised to lend as much money as possible. link Each time you double the number of currency units, the total value of the money is diluted across double the number of units and so the value of each unit is halved. If you do this too quickly, people lose confidence in the money and you fall into hyperinflation, but if you throttle it just right, they don't catch on. It helps that the value of consumables (cars, food, toothbrushes etc) goes down by around 5%/year due to technology-driven manufacturing efficiency gains. This means that they can devalue the curr

CitesView on HN
@circuit102023 · in “GitHub Copilot emits GPL code”

"those non-problems" Why is that a non-problem? It's a really important concern that we need to take more seriously I pasted this from another comment I wrote but: The concerns about AI taking over the world are valid and important; even if they sound silly at first, there is some very solid reasoning behind it. See ▶ this video for a really interesting video on why a theoretical superintelligent AI would be dangerous, and when you factor in that these models could self-improve and approach that level of intelligence it gets worrying…

RecommendsView on HN
@circuit102023 · in “Stability AI Launches the First of Its StableLM Suite of Language Models”

But the concerns about AI taking over the world are valid and important; even if they sound silly at first, there is some very solid reasoning behind it. They’re big matrices, yes, but they’re Turing-complete which means they can theoretically do any computational task See ▶ this video for a really interesting video on why a theoretical superintelligent AI would be dangerous, and when you factor in that these models could self-improve and approach that level of intelligence it gets worrying…

RecommendsView on HN
@johncs2022 · in “Perhaps It Is a Bad Thing That the Leading AI Companies Cannot Control Their AIs”

There's a great Computerphile video from 2015 that introduced me to the idea of AI safety awhile ago. It seems like some good context to this article: ▶ this video

RecommendsView on HN
@ExtraE2021 · in “Moore's Law for Everything”

I don’t see the world this piece presents panning out. Either we make general intelligence (which then scales almost instantly to be way, way smarter than any human ever and then accidentally kills us [1]) or we don’t and humans still have a role to play in the workforce. [1] ▶ this video

CitesView on HN
@throwaway20482019 · in “Artificial intelligence is changing every aspect of war”

We understand how people work and think pretty well, their edgecases, and countermeasures to said edgecases. We don't understand edge cases of AI much at all, and the terrain-space of "possible minds" they might be is vastly broader than that of a human mind, and utterly outside our experience. An AI might work with absolute 100% flawless precision for 100 years, then decided one day to kill everyone. A lot harder to see that coming from a totally alien intelligence than a human one. AI does not think like humans, have human values, or care about what humans care about, that might make them extremely unpredictable and dangerous. There will be no time for iterative development, or learning from our mistakes, a sufficiently advanced AI knows we would try to stop it, and make sure that we never can. ▶ this video

CitesView on HN
@pdkl952016 · in “Why AlphaGo Is Such a Big Deal”

> exponential leap forward A recent(-ish) Computerphile video has a good overview of the AI-self-improvement problem. link I recommend watching the previous video first, which introduces the problem of strong-AI rapidly finding solutions (especially with poorly-specified questions) that may not be in humanity's best interest. ▶ this video Before anybody jumps to overly-sensational conclusions, note that the last video in that series, Rob Miles explains how exponential self-improvement is an extreme point in the space of possible AI development. We don't know how to predict discoveries[1], so we need more research into AI, so we can hopefully make something that isn't exponentially growing beyond our understanding. link [1] see James Burke's non-teleological view of change

RecommendsView on HN
Why Not Just: Think of AGI Like a Corporation?15:27

Why Not Just: Think of AGI Like a Corporation?

Robert Miles AI Safety
163K views • 7 years ago
Why Would AI Want to do Bad Things? Instrumental Convergence10:36

Why Would AI Want to do Bad Things? Instrumental Convergence

Robert Miles AI Safety
274K views • 8 years ago
Intelligence and Stupidity: The Orthogonality Thesis13:03

Intelligence and Stupidity: The Orthogonality Thesis

Robert Miles AI Safety
710K views • 8 years ago
ChatGPT with Rob Miles - Computerphile36:02

ChatGPT with Rob Miles - Computerphile

Computerphile
517K views • 3 years ago
Why Asimov's Laws of Robotics Don't Work - Computerphile8:16

Why Asimov's Laws of Robotics Don't Work - Computerphile

Computerphile
873K views • 11 years ago
Intro to AI Safety, Remastered18:05

Intro to AI Safety, Remastered

Robert Miles AI Safety
210K views • 5 years ago
Avoiding Negative Side Effects: Concrete Problems in AI Safety part 19:33

Avoiding Negative Side Effects: Concrete Problems in AI Safety part 1

Robert Miles AI Safety
161K views • 9 years ago
10 Reasons to Ignore AI Safety16:29

10 Reasons to Ignore AI Safety

Robert Miles AI Safety
363K views • 6 years ago
How We Prevent the AI’s from Killing us with Paul Christiano1:57:02

How We Prevent the AI’s from Killing us with Paul Christiano

Bankless
63K views • 3 years ago
Superintelligence: Science or Fiction? | Elon Musk & Other Great Minds1:00:15

Superintelligence: Science or Fiction? | Elon Musk & Other Great Minds

Future of Life Institute
664K views • 9 years ago
The A.I. Dilemma - March 9, 20231:07:31

The A.I. Dilemma - March 9, 2023

Center for Humane Technology
3.7M views • 3 years ago
We Were Right! Real Inner Misalignment11:47

We Were Right! Real Inner Misalignment

Robert Miles AI Safety
271K views • 5 years ago
Eliezer Yudkowsky: Dangers of AI and the End of Human Civilization | Lex Fridman Podcast #3683:17:51

Eliezer Yudkowsky: Dangers of AI and the End of Human Civilization | Lex Fridman Podcast #368

Lex Fridman
2.2M views • 3 years ago
Can we build AI without losing control over it? | Sam Harris14:28

Can we build AI without losing control over it? | Sam Harris

TED
3.9M views • 10 years ago
AI does not exist but it will ruin everything anyway1:03:18

AI does not exist but it will ruin everything anyway

Angela Collier
697K views • 3 years ago
Is AI Safety a Pascal's Mugging?13:44

Is AI Safety a Pascal's Mugging?

Robert Miles AI Safety
388K views • 7 years ago
Glitch Tokens - Computerphile19:29

Glitch Tokens - Computerphile

Computerphile
353K views • 3 years ago
Training AI Without Writing A Reward Function, with Reward Modelling17:52

Training AI Without Writing A Reward Function, with Reward Modelling

Robert Miles AI Safety
259K views • 6 years ago
Munk Debate on Artificial Intelligence | Bengio & Tegmark vs. Mitchell & LeCun1:47:20

Munk Debate on Artificial Intelligence | Bengio & Tegmark vs. Mitchell & LeCun

Policy-Relevant Science & Technology
118K views • 3 years ago
AI "Stop Button" Problem - Computerphile20:00

AI "Stop Button" Problem - Computerphile

Computerphile
1.4M views • 9 years ago