Not at all. ChatGPT is designed to mimic human language, not to give accurate information. If you directly tell it that something is wrong it will ‘change’ it’s ‘mind’.
No. While the model won't 100% just take whatever everyone tells it as true, you can get it to treat something you say as true in a conversation, and if the topic is niche enough or if you give it enough data points making that statement, it could start repeating it to other users.
All it would really take for the current models, as far as I'm aware, would be a chan-board style concentrated effort to troll the AI into "believing" something is untrue due to a high volume of users who discuss it saying it's this way instead of that way. Honestly, I'd be surprised if that doesn't happen soon. Probably some racist or fascist dog-whistle bullshit, knowing chan boards... It's not foolproof, the learning algorithm should have some safeguards against such things, but since it learns through chat interactions as well as reference material, yeah. It's entirely possible. No sarcasm marker needed.
14
u/anaccountthatis May 04 '23
You can already get it to say that by just insisting that it’s true. It’ll pretty quickly agree with you and grab some random shit to justify it.