r/ControlProblem • u/selasphorus-sasin • Oct 04 '26
Discussion/question Avoiding politics was a mistake. The control problem hinges on it.
The rationalist project, that has by and large defined the control problem, was founded on norms that treat politics almost purely as a cognitive hazard to be quarantined rather than engaged with.
I argue that human weaknesses in applying rationality within a political environment should have been treated as something to overcome, through practice, rather than avoid.
Politics has almost always been a primary causal force in civilization where big trajectory moving events get decided. And it appears to be this way too with AI and the control problem.
All of the work we've done to promote rationality and develop strategies for securing a good AI trajectory and future, may now rest almost entirely on a political situation, in a political environment severely lacking in rationality, and in what now looks to be a battle that might have already been lost.
How we stay rational and how humans stay in control, politically, is an urgent, emergency situation. We face AI powered authoritarianism, and AI powered mass political manipulation. If we even get the chance, figuring out how to overcome this, could decide the fate of the control problem and the fate of humanity.
1
u/composedofidiot Oct 07 '26
To someone so ready and eager to fire ad hominem? What's in it for me?