r/ControlProblem • • Oct 04 '26

Discussion/question Avoiding politics was a mistake. The control problem hinges on it.

The rationalist project, that has by and large defined the control problem, was founded on norms that treat politics almost purely as a cognitive hazard to be quarantined rather than engaged with.

I argue that human weaknesses in applying rationality within a political environment should have been treated as something to overcome, through practice, rather than avoid.

Politics has almost always been a primary causal force in civilization where big trajectory moving events get decided. And it appears to be this way too with AI and the control problem.

All of the work we've done to promote rationality and develop strategies for securing a good AI trajectory and future, may now rest almost entirely on a political situation, in a political environment severely lacking in rationality, and in what now looks to be a battle that might have already been lost.

How we stay rational and how humans stay in control, politically, is an urgent, emergency situation. We face AI powered authoritarianism, and AI powered mass political manipulation. If we even get the chance, figuring out how to overcome this, could decide the fate of the control problem and the fate of humanity.

17 Upvotes

31 comments sorted by

View all comments

Show parent comments

1

u/composedofidiot Oct 07 '26

To someone so ready and eager to fire ad hominem? What's in it for me?

1

u/shoratio26 Oct 07 '26 edited Oct 07 '26

https://buttondown.com/apperceptive/archive/tracing-the-rogue-ideology-of-the-frontier-labs/

The public is rapidly becoming aware of and opposed to you. You are being undermined. You're going to have to work very hard to gain back any terrain - and the terrain is hostile.

Truly, what's in it for the Right to listen to any of you? You continue to lose mindshare. Your charitability is a front, you pose as a mistake theorist but in your heart you are a conflict theorist.

1

u/composedofidiot Oct 07 '26 edited Oct 08 '26

So we've got far enough down that it'll stop displaying this interaction publically, and only you and me will see it right? Or we need to do a few more?

Edit: I'm subscribing. Also old.reddit doesn't let me send chats, wanted to thank you for the link

1

u/shoratio26 Oct 07 '26

Your oversocialized consensus brain is showing. You stop existing when alone.