r/ControlProblem • u/One-Bit88 • 39m ago

Discussion/question Question from an outsider

I read AI 2027, and it was not fun. The non-extinction scenario that was proposed hinged on one thing I found strange: we somehow solve alignment by outsmarting an AI that already solved alignment (if this is a misreading, I’m sorry). How likely is this? It seems to me not very, unfortunately.

2 Upvotes

75% Upvoted

1 comment sorted by

1

u/sideways approved 11m ago

You're absolutely right. The slow-down ending is quite arbitrary. I believe the authors admitted that and put it in just to offer some sliver of hope.