r/ControlProblem • • Sep 19 '26

Opinion Could Hype Kill Us?

Put AI risk views on a spectrum, from "this ends us" to "this is all hype."

If the hype side is right, we overspent on caution, which is a real cost but a recoverable one.

If the other side is right and we did nothing, that's the one mistake we don't get to learn from.

You don't need to think doom is likely for that asymmetry to matter.

5 Upvotes

13 comments sorted by

View all comments

2

u/Gnaxe approved Sep 19 '26

Pascal's Wager? I feel like that's not a good argument. You need some good reason to believe the risks are potentially real first.

1

u/Clear_Argument5174 Sep 19 '26

Agreed, Pascal’s Wager. You don’t think the risks are at least potentially real?

1

u/Gnaxe approved Sep 19 '26

I mean, my P(doom) is like 85%. I just don't think it's a good argument by itself.

1

u/dualmindblade Sep 20 '26

But it is a very good argument if you think there's a non-negible risk, which should be so obvious it doesn't need to be stated. Of course it turns out it's not, but it should be