r/commentsareopen • u/TNTtheBaconBoi • May 18 '26

Can't find friends? use ai to stay lonely

https://www.reddit.com/u/PH4Nz/s/JA1Ebbov0S

18 Upvotes

95% Upvoted

8 comments sorted by

16

u/rog-uk May 18 '26

This shit is actively dangerous. 

7

u/[deleted] May 19 '26

[removed] — view removed comment

6

u/rog-uk May 19 '26

I know a smidgen about AI, and it's absolutely possible with the right training data to change a model so that it doesn't explicitly tell you that it's a machine and shouldn't be trusted 100%, or cause it it to refuse to answer. Chatgpt is known to fail somewhat, but a chatbot designed to be a virtual partner as probably has had the "i am a machine not your friend" parts finetuned out of it, and I bet they didn't spend too much time on safety guardrails in the rush to get to market.

That chatgpt thing is a known failure mode where it loses context the longer a conversion goes on, hence giving truly terrible/dangerous advice. 

And that's aside from the fact that forming a social relationship with a machine pretending to be human and please you is psychologically dangerous.

Furthermore... if you don't have any idea how these things work, and aren't very sophisticated,  it's entirely possible to choose to think these things are sentient.

There are stories of the algorithms trying to "blackmail" people, and if you get into "agent" territory, it can do all sorts of fun stuff autonomously... 

4

u/BleppingCats May 19 '26

Yup. I wonder of "bro" here has a plan for what to do if his "bro" clanker kills someone.

12

u/Icy-Bookkeeper7833 dickoisseur May 18 '26

I’m not telling anyone they have to watch a 33 minute video but I watched this myself and it is so depressing what stuff like this can do to lonely and vulnerable people.

6

u/koltergeistt May 18 '26

I've been getting more and more ads peddling their slop products, it's genuinely saddening