Is AI Safety a Pascal's Mugging?
Robert Miles AI Safety 3 HN recommenders · recommended in 4 months, 2019–2026
explainer · intro · evergreen · 2019–2026 on HN
Robert Miles examines whether the case for AI safety is a Pascal's mugging, a tiny probability of an enormous payoff. He argues it is not, because AI risk does not depend on vanishingly small probabilities.
HN points to it as a reasoned rebuttal to the claim that AI risk is just Pascal's wager.
Up next
9 mo on HNQuantum Entanglement & Spooky Action at a Distance
Veritasium
9 HN recommender · 2015–2022
3 mo on HNThe Halo Drive
Cool Worlds
3 HN recommender · 2019–2023
8 mo on HNWealth Inequality in America
politizane
8 HN recommender · 2013–2025
5 mo on HNRenting vs. Buying a Home: The 5% Rule
Ben Felix
6 HN recommender · 2020–2026
3 mo on HNI tried using AI. It scared me.
Tom Scott
4 HN recommender · 2023–2025
5 mo on HNFeynman: How to think 1 of 2 FUN TO IMAGINE 11
Christopher Sykes
5 HN recommender · 2011–2024
3 mo on HNTUN: Un-Ruining the MMO
MrBtongue
2 HN recommender · 2016–2022
7 mo on HNHow close is nuclear fusion power?
Sabine Hossenfelder
15 HN recommender · 2021–2022
11 mo on HNWhat Happened to Horses Is Happening to Us
CGP Grey
11 HN recommender · 2014–2026
6 mo on HNWhy Would AI Want to do Bad Things? Instrumental Convergence
Robert Miles AI Safety
6 HN recommender · 2019–2023
6 mo on HNVeritasium: What Everyone Gets Wrong About AI and Learning – Derek Muller Explains
Perimeter Institute for Theoretical Physics
6 HN recommender · 2025–2026
6 mo on HNIntelligence and Stupidity: The Orthogonality Thesis
Robert Miles AI Safety
6 HN recommender · 2022–2026
4 comments from Hacker News
Here’s a video called “Is AI safety a Pascal’s Mugging?”: ▶ this video From what I remember the main point of the video is that kind of situation happens when the probability involved is vanishingly small, and all the events you listed don’t have a vanishingly small probability, so they are not Pascal’s wager situations, just a normal rational safety concerns with particularly high consequences
The difference to Pascal’s wager is that with that the probability is vanishingly small, but given current progress the probability of AI causing an existential threat is actually quite high. You can’t just call anything that has very bad negative consequences Pascal’s wager Video about this: “Is AI Safety a Pascal’s Mugging?” ▶ this video
All of this discussion really makes me think of Robert Miles "Is ai safety a Pascal's mugging?" from 4 years(!) ago[0]. All of this discussion has been had by Ai safety researchers for years in my layman understanding... Maybe we can look to them for insight in to these questions? [0] ▶ this video
Pascal's wager is actually logically flawed. If there are two separate AGI invented, and you could only have chosen to invest in one, then where's the infinite capture of value? See this video on a reasonable argument about this: ▶ this video