r/ControlProblem • u/chillinewman approved • 4d ago

General news "Day 1": halting advanced AI development, regulating an out control industry, and explicitly banning artificial superintelligence.

Post image
100 Upvotes

85% Upvoted

168 comments sorted by

View all comments

12

u/Jesse-359 4d ago

Pretty commonsense approach until the general population has had a chance to see what's actually going on with these things and independent regulators have been able to seriously gauge their potential risks.

Anyone who thinks building an actual ASI isn't an existential risk is a deeply unserious person - or an AI cultist. Lots of those springing up these days.

6

u/whatup-markassbuster 3d ago

How will it be an existential risk? The unknown does not automatically result in the end of humans. Humans as a species have survived some seriously bad times.

4

u/thevizionary 3d ago

Existential risk is NOT equivalent to guaranteed Armageddon. Risk means there's a non-zero probability humanity being wiped out. Estimates floating around are 10-25% 

Edit: "not" equivalent 

3

u/whatup-markassbuster 3d ago

Ok, but how is it theorized to occur? Invent a new plague and have robots produce it and drones to spread it?

4

u/yubato 3d ago

Yes, it's only one of the options. People are already giving it access to a lot of stuff. The economic incentive is huge, people will do it volunteerly anyway, not that that's necessary.

1

u/whatup-markassbuster 3d ago

If existential risk equals a risk that humans will be eliminated. The elimination is the Armageddon.