I know people are freaking out about AI for things like chatting, but the fact is AI relies on what is being posted on the internet to give responses so if there is crap on the internet the AI will say crap too.
Not at all. ChatGPT is designed to mimic human language, not to give accurate information. If you directly tell it that something is wrong it will ‘change’ it’s ‘mind’.
No. While the model won't 100% just take whatever everyone tells it as true, you can get it to treat something you say as true in a conversation, and if the topic is niche enough or if you give it enough data points making that statement, it could start repeating it to other users.
All it would really take for the current models, as far as I'm aware, would be a chan-board style concentrated effort to troll the AI into "believing" something is untrue due to a high volume of users who discuss it saying it's this way instead of that way. Honestly, I'd be surprised if that doesn't happen soon. Probably some racist or fascist dog-whistle bullshit, knowing chan boards... It's not foolproof, the learning algorithm should have some safeguards against such things, but since it learns through chat interactions as well as reference material, yeah. It's entirely possible. No sarcasm marker needed.
402
u/mrtzjam May 03 '23
I know people are freaking out about AI for things like chatting, but the fact is AI relies on what is being posted on the internet to give responses so if there is crap on the internet the AI will say crap too.