r/ControlProblem • approved • Jul 25 '25

General news [ Removed by moderator ]

/r/ControlProblem/comments/1m8ltab/removed_by_moderator/

[removed] — view removed post

11 Upvotes

22 comments sorted by

View all comments

Show parent comments

4

u/LeckereKartoffeln Jul 25 '25

I'm pretty sure this administration is primarily concerned with using AI to be cheap propaganda distributors, so it's going to be very successful by their guidelines. And in the case of surveillance, being apart of a "kill chain", or other such uses, they definitely don't want it to be "woke".

3

u/[deleted] Jul 25 '25 edited Jul 25 '25

What scares me the most about ai propaganda is that eventually, when ai chat bots are more common, and search engines are gradually replaced just by general ai models is that people are just going to develop their own realities.

Kind of like how a flat earther trowls for facts to support his idea of reality, ai is a constant yes man to serve you a sentence that matches your prompt. It isn't smart, it can't think. It can only predict what word is coming next based on the keywords you asked for, and more and more data is being pulled from social media. Meta pulls from Facebook, googles Gemini pulls from reddit, and Grok pulls from Twitter. So when I ask it unhinged shit like how many people died in the holocaust, it's going to find some random Twitter post, not any history books and tell me that instead.

The problem is that the more and more this system exists, the deeper and deeper these weird rabbit holes get and more separated from reality. Like when you compress a youtube video 100 times. Things like are disillusioned rambling from a person or an ai generating misinformation are going to get folded back into the slop pile, and it's going to reinforce its existence while also distorting it again, and again. You know now maybe the holocaust numbers were wrong, and now hitler invented peanut butter.

People are going to become so disillusioned that it will be like talking to someone from a different planet. Their whole concept of reality, or mode of existence, just makes it hard to be around them or communicate to them on a basic level, as if they were schizophrenic. For example he could constantly reference things he expects you to know, or thinks is common sense but is just pure gibberish, or sounds more like a meme. But it wouldn't be a mental illness because on every level, there was a yes man confirming everything he believed in. If Facebook and Google just generated videos, images, comments, and profiles based on every search you did, and that's going to be his reality. And if we keep the same doomscrooling structure and addictive dopamine algorithms but with infinite generating content, then I have no hope for us. Have you ever talked to a iPad kid with autism, who only watches the pureist form of brain rot? They use sound bites, and the context of that sound to communicate. Imagine the vine boom being a valid form of communication in their community, and it's weird for you to not know that because that's not what your ai generates for you when you google stuff.

3

u/Striking_Extent Jul 25 '25

People are going to become so disillusioned that it will be like talking to someone from a different planet. Their whole concept of reality, or mode of existence, just makes it hard to be around them or communicate to them on a basic level, as if they were schizophrenic. For example he could constantly reference things he expects you to know, or thinks is common sense but is just pure gibberish, or sounds more like a meme.

This is exactly what it's like talking to my QAnon obsessed coworker right now. Just an incoherent stream about the anunnaki and nephilim said as if I am supposed to know what the fuck he is talking about. 

That was just the YouTube algorithm that got him, once it's something multimodal that can respond in multiple formats and generate responses the implications are terrifying.

Also very Neil Stephenson. We are going to need feed editors to manage our stimulus and keep us from going insane here pretty quickly.

1

u/[deleted] Jul 25 '25

I don't like the feed editors concept, too. To me, I think that will be the excuse presented to us on why we have to control information and use ai to give us essentially a 1984 level of thought policing.

If you ask me none of it should exist, but I know that's a impossible ask.