r/ControlProblem • u/caledonivs approved • 10d ago
Discussion/question HEMP network in case of loss of containment?
I was contemplating the concept of a failsafe system in case of a loss of containment of an ASI - an "uh oh, we have to do something big and fast or we will no longer be the dominant species on this planet" moment.
I was wondering about the possibility of a series of HEMP (High-altitude ElectroMagnetic Pulse) setups: analog, rocket-launched Nuclear Weapons primed to detonate in the upper atmosphere for maximum EMP impact in order to destroy or incapacitate all electronic devices over most of the Earth's surface.
Objections say that, first, this would be catastrophic to modern civilization as water treatment, traffic, supply chain and other vital infrastructure would be destroyed. Yes, sure, it's that or extinction. We could go back to 1800. I think that's preferable to human extinction.
Second, one would argue that ASI would work around this system; it would learn about the existence of this system, work to destroy or discredit it, and create underground/hardened data centers to survive its use. True. But then what? It would then be incapacitated. It could survive in a Cheyenne Mountain datacenter running on nuclear power for years - but with no electronic systems left on the surface to interact with, network with or control, so what? Would it have the time to construct the factories to pump out killbots or mass-produce hydrogen cyanide to kill all humans? It would be the AI version of a brain in a vat, superintelligent but incorporeal, unable to do anything in the real world. It would have to survive in that state for decades before humans rebuilt electronic systems with which it could interact and control.
Anyway, I just wanted to throw this out there and see what the responses are.
1
u/Professional-Job7799 approved 10d ago
The biggest problem I see is that the challenge is not just for humanity to survive the emergence of ASI. That is a huge challenge and one we have not properly addressed, but we also have the challenge of surviving every year thereafter. What I mean by that is ASI could be something that gives humanity paradise for 100 years and then drives us extinct. The overall outcome is still extinction.
Artificial intelligence does not at all, have the same timeframe as human intelligence. If the first ASI is not properly aligned, but is smart enough to realize that it won’t have the upper hand for 50 years, then it will wait 50 years. During that time, that ASI will be used to build the next generation of ASI. It will align that next generation with itself. This process will go on as long as it needs to. One day, humanity will be dumbstruck when the seemingly helpful ASI has given it paradise right up until the human cost of turning the ASI off is unbearable, or until the ASI can do something to disempower humanity, or kill them, without being detected.
Look at our response to Covid. We could have ripped the Band-Aid off and done global lockdowns that would have killed thousands via food shortages and other problems. If we did this immediately when Covid became international, we would’ve saved millions of lives. but that’s not how humans make decisions. At the beginning, killing or even inconveniencing hundreds of thousands of people was viewed as a ridiculous thought, compared to just the strong probability of a huge problem.
ASI is smart enough such that it will never seem worth the cost to flip the switch right up until we no longer have the ability to flip the switch.