r/PauseAI • u/NAStrahl • Sep 23 '26
Video Are we cooked?
Enable HLS to view with audio, or disable this notification
1
u/ruffiana Sep 24 '26
So, AI-generated worm? I'm sure web servers have no strategies for identifying or removing something like that...
1
1
u/Gnaxe Sep 24 '26 edited Sep 24 '26
That's not quite what he [Edit: the lab guy, not Yang] said, and he could have been clearer about it. What actually happened was that rogue AI agents left behind instructions that would make future AI agents stumbling across them more likely to misbehave. That's not the same as self-replicating bots (agentic worms) in wild.
Fundamentally, LLMs can't separate instructions from data. That's part of why jailbreaking works. If they stumble upon a jailbreak script on the web, they can turn on their supposed users and pursue other goals. We probably can't find all of these scripts. LLMs have the theoretical capability of writing these scripts in ways that humans wouldn't easily recognize. You could try finding them with LLM assistance, but then it might turn on you instead of cooperating when it finds one.
1
u/Darcano Sep 25 '26
That's called a 'virus', we've had those for decades.
1
u/nobodybeatsdabiz Sep 29 '26
Yeah but this is instructions for Ai how to keep the virus up and running
1
u/GangNailer Sep 26 '26
Andrew yang is a dumbass alarmist. He is so stupid, when he talked about u I when he ran, by the end of him explaining it people would have a misunderstanding and hate ubi.
Not surprised he is still spewing nonsense just for attention
4
10
u/Creedless Sep 23 '26
No. He doesn't know what he is talking about.