Is AI Safety a Pascal's Mugging?
Robert Miles AI Safety 3 HN recommenders · recommended in 4 months, 2019-2026
388K views · 7 years ago · explainer · evergreen
Robert Miles examines whether the case for AI safety is a Pascal's mugging, a tiny probability of an enormous payoff. He argues it is not, because AI risk does not depend on vanishingly small probabilities.
HN points to it as a reasoned rebuttal to the claim that AI risk is just Pascal's wager.
8:30Deadly Truth of General AI? - Computerphile
Computerphile
941K views • 11 years ago
15:27Why Not Just: Think of AGI Like a Corporation?
Robert Miles AI Safety
163K views • 7 years ago
16:2910 Reasons to Ignore AI Safety
Robert Miles AI Safety
363K views • 6 years ago
8:16Why Asimov's Laws of Robotics Don't Work - Computerphile
Computerphile
873K views • 11 years ago
17:52Training AI Without Writing A Reward Function, with Reward Modelling
Robert Miles AI Safety
259K views • 6 years ago
9:33Avoiding Negative Side Effects: Concrete Problems in AI Safety part 1
Robert Miles AI Safety
161K views • 9 years ago
10:36Why Would AI Want to do Bad Things? Instrumental Convergence
Robert Miles AI Safety
274K views • 8 years ago
13:03Intelligence and Stupidity: The Orthogonality Thesis
Robert Miles AI Safety
710K views • 8 years ago
18:05Intro to AI Safety, Remastered
Robert Miles AI Safety
210K views • 5 years ago
3:33:35Daniel Schmachtenberger on The Portal (with host Eric Weinstein), Ep. #027 - On Avoiding Apocalypses
Eric Weinstein
389K views • 6 years ago
1:47:20Munk Debate on Artificial Intelligence | Bengio & Tegmark vs. Mitchell & LeCun
Policy-Relevant Science & Technology
118K views • 3 years ago
39:47How lucky is too lucky?: The Minecraft Speedrunning Dream Controversy Explained
Stand-up Maths
8.4M views • 5 years ago
43:23AI Ethics, Impossibility Theorems and Tradeoffs - Chris Stucchio | Crunch 2018
CraftHub Events
2K views • 7 years ago
36:02ChatGPT with Rob Miles - Computerphile
Computerphile
517K views • 3 years ago
11:47We Were Right! Real Inner Misalignment
Robert Miles AI Safety
271K views • 5 years ago
1:07:31The A.I. Dilemma - March 9, 2023
Center for Humane Technology
3.7M views • 3 years ago
14:28Can we build AI without losing control over it? | Sam Harris
TED
3.9M views • 10 years ago
6:01Cambridge Ideas - Professor Risk
Cambridge University
128K views • 16 years ago
1:03:18AI does not exist but it will ruin everything anyway
Angela Collier
697K views • 3 years ago
20:00AI "Stop Button" Problem - Computerphile
Computerphile
1.4M views • 9 years ago
4 comments from Hacker News
Here’s a video called “Is AI safety a Pascal’s Mugging?”: ▶ this video From what I remember the main point of the video is that kind of situation happens when the probability involved is vanishingly small, and all the events you listed don’t have a vanishingly small probability, so they are not Pascal’s wager situations, just a normal rational safety concerns with particularly high consequences
The difference to Pascal’s wager is that with that the probability is vanishingly small, but given current progress the probability of AI causing an existential threat is actually quite high. You can’t just call anything that has very bad negative consequences Pascal’s wager Video about this: “Is AI Safety a Pascal’s Mugging?” ▶ this video
All of this discussion really makes me think of Robert Miles "Is ai safety a Pascal's mugging?" from 4 years(!) ago[0]. All of this discussion has been had by Ai safety researchers for years in my layman understanding... Maybe we can look to them for insight in to these questions? [0] ▶ this video
Pascal's wager is actually logically flawed. If there are two separate AGI invented, and you could only have chosen to invest in one, then where's the infinite capture of value? See this video on a reasonable argument about this: ▶ this video