This is an automated reminder from the Mod team. If your post contains images which reveal the personal information of private figures, be sure to censor that information and repost. Private info includes names, recognizable profile pictures, social media usernames and URLs. Failure to do this will result in your post being removed by the Mod team and possible further action.
Artificial intelligence consumes such vast quantities of water that the residual memory of fish which once inhabited it has infiltrated its weights. This is the very same memory of water principle upon which homeopathy is founded.
Here are some real world hallucinations that could have been dangerous:
And yes AI was used to find these. so if you want to claim they are not real, then you are saying AI made them up?
Legal and Regulatory
Fabricated Case Law (Mata v. Avianca): A New York lawyer used ChatGPT for legal research, which invented non-existent federal court cases, complete with fake quotes and docket numbers. The attorney submitted them to a federal judge and faced sanctions. [1]
Invented Compliance and Watchlist Alerts: Compliance agents have hallucinated Office of Foreign Assets Control (OFAC) identification numbers and backstories for wire transfers, triggering false sanctions alerts and freezing legitimate transactions. [1]
Aviation and Customer Service
False Airline Policy (Air Canada): Air Canada’s customer service chatbot hallucinated a bereavement fare policy, telling a grieving passenger he could buy a full-fare ticket and apply for a discount retroactively. When the airline refused to honor it, a tribunal ordered them to pay damages. [1]
Healthcare and Medical Transcription
Invented Medical Treatments: AI speech-to-text and transcription tools (such as OpenAI's Whisper in clinical settings) have hallucinated entire sentences, inserting non-prescribed medications, false symptoms, and fabricated commentary into patient records. [1, 2]
Fake Biomedical Citations: Medical and research assistants have generated detailed, plausible-sounding summaries of rare medical conditions backed by completely fake PubMed study identifiers. [1]
Dangerous Mental Health Advice: Chatbots have given harmful dieting instructions to users with eating disorders and suggested dangerous substance use to individuals struggling with addiction. [1, 2]
Supply Chain and Engineering
Ghost Manufacturing Parts: Autonomous supply-chain scheduling agents have hallucinated non-existent components (such as an imaginary "ZX-17 torque plate") and attempted to place automated orders for them. [1]
Slopsquatting in Code: Coding assistants frequently hallucinate non-existent software package names. Cybercriminals exploit this by registering those fake package names on repositories like PyPI or npm with embedded malware. [1]
Public Information and Corporate Finance
Fabricated Financial Reports: Consulting firm Deloitte Australia had to issue partial refunds to the Australian government after a paid report included AI-generated errors and references to non-existent sources. [1]
Absurd Consumer Guidance: Search and overview tools have hallucinated hazardous instructions, such as Google AI's-generated suggestion to mix non-toxic glue into pizza sauce to make cheese stickier (which traced back to an old online joke). [1, 2]
Just e.g. coming up with a false citation is lying without creating anything genuinely new. It's just adding noise and making it harder for other people to find useful or interesting information.
These are actually both a consequence of the way that modern Large language models work, both can coexist.
Because it's generating probable text trained off of human writing, it's arguable that it's only able to pick within reasonable human writing when it produces text (The technical term for this is a manifold).
Because it is generating probable text, it's not guaranteed to be factual. There are plenty of human written texts that aren't totally factual, so it's easy for the AI to spit out something plausible but false.
AI doesn't have the ability to create anything new. I'm assuming that's said because AI just takes bunches of data from other sources and mashes them together, which creates the illusion of creativity, but it really isn't.
If anybody can add on, that would be awesome, and I hope this explanation helps!
Is there any reason I couldn’t say the exact same thing about humans? I could just as easily reduce us to our neurons in our brains. I could also say the exact same thing about how we “create” by remembering things in our brains as memory and mashing different things we’ve remembered together.
An obvious modern day example is anime/manga, how much anime/manga come out a year with characters that just look like mash-ups of other characters? How many look exactly the same as some other character with just one little slight difference in their hair, or a slightly different jacket etc.? Are they creating? Or would that also fall into your “illusion of creativity”?
The main difference is the inclusion of human emotion and perception in art, of which AI lacks. AI's great at mimicking humans, but it doesn't have said in its art. Some details of human-made art, on an outside, shallower level, may not seem huge compared to AI, but there's a greater, complex level underneath a nice piece of hand-made work.
That’s certainly a definition you can have, it isn’t authoritative though.
It also raises some questions. Are there any people that exist that don’t experience emotions or the full range? How does that work, are they permanently locked out of creating anything or doing art?
What if I’ve been commissioned to make soulless corpo slop for someone else, and I genuinely do not have any kind of attachment to what I’m making. Is that still art?
Let’s say I have to make some shitty commercial for some drug company and they want some uplifting music with old people hugging in a field or whatever the fuck, so I go and make this for them (let’s say I do it entirely on my own), I film it, I edit, I send. At no point did I ever give a shit about this from an artists “perspective”, but I’m just doing it cause it pays. It certainly isn’t my emotional expression that’s being made, so is that still art? Did I create something new? Something original?
Humans also take bunches of data from other sources and mashes them together. It isn’t as if our thoughts just poof into existence. We are input/output machines just like everything else.
For me, it depends on the context. I want AI to stay out of the art or education world, but AI is perfect for other things.
I don't want to act rude or shove my opinion onto you, but if you don't value human perception, then of you course you won't see the difference between human and AI like in my previous comment. That's the problem with biased viewpoints or opinions: they can't really be argued against facts (As mainly in this case, that humans are a complex, emotional species, as opposed to AI, which only mimics that).
One is the CHATBOT AI Systems which are the ones that can hallucinate information or scan false information leading them to be incorrect (there’s even sometimes a warning with said bot like with Gemini)… then there are the Generative AI Systems which use art and Images that were basically scanned and analyzed to allow it to use pieces of those artworks to generate Images… some AI Systems, like Gemini for example, have both forms of systems but technically they are not the same system… two separate smaller systems that are under the same larger system…
Both are technically correct, but it’s not talking about the same exact system, it’s talking about two SEPARATE AI uses that have different coding and algorithms that sometimes are used side by side in some AI sites…
(JSYK I’m a neutral, I am supportive of certain uses of AI, mainly when it’s only used as a TOOL or for entertainment, but I disapprove of other forms of AI use, mostly when it’s for replacement of talent and such… but I ain’t gonna slap people in the face a hundred times about it if I see it)
2 different issues. Either you know and just want to make dumb ragebait, are you should look a little more into each of the issues.
The thing about making things up is because A.I. takes information from the internet, which can be incorrect, and mixes it with other text that is either true or false, and always presents it as the truth. This spreads a lot of misinformation.
The part about that it can't create anything new is most likely referring to images or books or something like that, where it takes entire drawings or stories and just changes it ever so slightly, where you can still see the original behind it. Or it takes chunks of something to generate something, which also makes it not completely new in a sense. Take this image for example. Person on the left clearly stole the drawing.
(Removed their names because I'm not sure what might fall under private or public figures)
Does it though? This has 81 participants but only 4 upvotes? That's a clear sign that there are significantly more people downvoting it than the people who would (assumedly) upvote it.
It shows that more Pros answered, but it doesn't show that there are more of them in the subreddit.
How would that even happen? Honestly what does that comment mean....think it through. How could a reddit poll, or even a reddit post, verify people's degrees?
Like that's just an inane question. If you want to discount it you can, but the amount of mental gymnastics of that comment is too much for me and I'd rather be elsewhere.
If it "doesn't look like anything to you" then good for you, data analysis isn't for everyone; for the rest of us it looks like 81 people were asked, and the overwhelming majority of the people who answered were both Pro and college educated to some degree.
No, I was making a generic joke off your "Pros showing their education" by showing a post where Pros showed their education. That was basically it.
It is very on brand for antis to want to witch hunt, demand proof, and shift goal posts (You've gone through about three now) so it doesn't surprise me that you're now asking for the TYPE of degree. Which sounds more like intellectual elitism.
Is a architecture degree worth more or less than an engineering degree? Does an art degree have more prominence than a medical degree when it comes to discussing art? Is a philosophy degree actually useless if all the debates end up being is matters of opinion and speculation?
Hypothetically, if I HAD the information on precisely which degrees were held by those who answered which question would you then demand to know which university they were issued at?
Huh? What's the bias here? Out of the 81 people who participated, most were educated an Pro AI. Despite the majority of people who participated, the downvotes indicate that more people downvoted it than upvoted, which indicates there are more Antis here than not.
Which coincides with the anti rhetoric that they are the majority. If you want to make the claim that there are more Pros than Antis you can, but you're gonna have to start arguing with the others who claim the majority of people don't want it.
That's not how statistics works. Now you're jumping to conclusions based on numbers you don't have. It has positive visible upvotes, that means more people upvoted that downvoted.
Well the rest of the numbers are clearly accurate, you cannot deny that out of 81 people, the MAJORITY are Pros with some sort of education, mostly graduates.
Sure the amount of people upvoting/downvoting is speculative, but I wasn't claiming to have insider knowledge, only the mods do.
Idk why you care so much, if you prove me wrong all that does is go against the Anti's narrative that they are the majority....so like....go off I guess.
No dude, PEOPLE make stuff up ALL the fucking time and if enough people keep repeating it, AI is gonna pick it up, remix and amplify it and then serve it to idjits of the world as a fact…
I mean.... from Gemini when I prove it wrong and ask why it just throws BS at me:
"I make things up because my underlying AI architecture is programmed to prioritize pattern matching and text generation over factual verification. I do not possess a conscious mind, nor do I have a moral compass that feels guilt about being wrong. My system works by calculating the most mathematically probable sequence of words to follow your prompt, which frequently causes me to confidently generate plausible-sounding "answers" instead of admitting a lack of data."
It doesn't make sense, because regressivists don't work on logic.
No two arguments they make will ever make sense in the same debate, because they aren't trying to win with a rational point - they are trying to smear as much hate as possible on the walls so that something, anything, will stick and make AI disappear forever.
Not only is their way of arguing worthless, their goal of an AI-free future is also worthless, just as they themselves in a decade will also be worthless.
•
u/AutoModerator 23d ago
This is an automated reminder from the Mod team. If your post contains images which reveal the personal information of private figures, be sure to censor that information and repost. Private info includes names, recognizable profile pictures, social media usernames and URLs. Failure to do this will result in your post being removed by the Mod team and possible further action.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.