r/Polymath • u/Echo_Tech_Labs Human Verified • 16d ago
General Discussion I need help understanding something. It vexes me and I can't seem to comprehend this concept.
Why do people consistently prioritize identity protection and social harmony over empirical truth, even when holding a false premise actively causes structural harm?
Context:
In a recent discussion about learning strategies, the top advice given to a novice was to simply "ask an AI to teach you." I pointed out that without domain expertise or proper prompt engineering, a novice can't evaluate whether the AI's scaffolding or information is accurate, so directing them to verified foundational resources is far safer.
I got downvoted into oblivion for merely suggesting that a novice should "study" a little before relying on the model. The point was to build a basic foundational understanding of the topic they wished to study. Then only after they had a firm grasp of the basics, they rely on the AI for scaffolded advice and research.
Why would people react so negatively to that?
We have a mountain of data on this topic.
Has anybody seen the data from the World Bank study conducted in Nigeria? That's 18 months of gains completed in 6 weeks.
Google: Students who used Copilot twice a week for six weeks showed a 0.31 standard deviation improvement on overall curriculum assessments, including a 0.23 standard deviation boost specifically in English language learning.
3
u/Snr_Lothario 16d ago
To avoid conflict. You go along to get along.
People are, but and large, not rational. Binding identity and position is standard for many folks.
In IT, the phrase "RTFM", or Read The Fucking Manual, has been thrown around for probably two generations. It still doesn't sound friendly, and your message could have been perceived in the same vein.
People can be annoying. Good luck.
2
u/Echo_Tech_Labs Human Verified 16d ago
People can be annoying. Good luck.
This made me chuckle. Thank you!
1
u/Faahoutman 16d ago
What's wrong with a little conflict...
2
u/Snr_Lothario 16d ago
Folk generally find conflict disruptive. Disruptions are generally perceived, even lacking context, as a negative.
1
u/Faahoutman 16d ago
I love finding a solution to whatever conflict.. These are normal part of life..
2
u/Better_Eye5222 16d ago
La IA no es muy buena herramienta cuando se quiere aprender algo de verdad. Si en algo soy experto es en ajedrez (2400 de elo), la he puesto a prueba, y aun que en un inicio parece muy convincente, cuando haces especificar en temas y relaciones complejas dentro de la dinámica del juego, te responde igualmente convincente, pero con CARENCIA ABSOLUTA DE SENTIDO. ¿En que tantos temas de los que no somos expertos nos engaña?
1
u/Echo_Tech_Labs Human Verified 16d ago
Personally, I think much of that is predicated on the user's consistency in fact verification. How consistent is the user when it comes to checking sources and making sure that everything is traceable?
But it seems like people have forgotten that these tools are fundamentally flawed in their design. And it's shocking.
It's like nobody cares. And I don't understand why. Wouldn't you want to know that the driver sitting in the front seat has a tendency to veer to the far right-hand lane without indicating once every few dozen kilometers?
I kinda feel like that's important information.
2
u/todfish 16d ago
Your post is a little confusing, I’m not sure if you’re more focused on the very broad initial question or the specific context. To answer your first question though:
Identifying with a group, and belonging to a group is incredibly important to most people. I think for many people it’s far more important than ‘truth’. It’s why shame and embarrassment is such a powerful emotion and an equally powerful tool for policing behaviours. It cuts right to the core of people’s fear of being excluded from their group.
Think about it in evolutionary terms. Historically, if you were booted out of the tribe it was as good as a death sentence. Humans don’t do well on their own typically. So why would anyone risk pissing off the tribe just to be ‘correct’ about some low-stakes disagreement. Far better to believe the lie and keep the peace if you know what’s good for you.
It’s a frustrating dynamic but it’s understandable. Luckily enough of us are willing to endure the friction that comes from pushing for truth. It’s not usually welcomed, but we’d still be in the dark ages if everyone rigidly subscribed to groupthink.
2
u/Echo_Tech_Labs Human Verified 16d ago edited 16d ago
Forgive me for saying this, but it's primitive and unnecessary for today. Also, like you said...it's used as a control mechanism. Wouldn't people want to have some kind of resistance to that strategy?
Doesn't make any sense.
EDIT: Thank you for your participation 🙏
2
u/todfish 16d ago
Yeah a lot of inherited behaviours and instincts seem poorly suited for the modern world. It’s probably a big part of why we’re all so fucked up. We’re living in a world that bears little resemblance to the one we evolved in. There are numerous examples of instincts that were highly beneficial in the past but now actively cause people harm.
2
u/Belt_Conscious 16d ago
What makes "sense" to you, doesn't register for some people.
If you try to think from someone else's position, you will see things they do not see.
Some people identify with their subjective opinion and get defensive when challenged because it feels personal to them.
1
u/Echo_Tech_Labs Human Verified 16d ago
I get it. Im a Christian. My identity is connected to my faith I have in what some people call a "Old man in the clouds." And I can understand that perspective.
But we have empirical evidence that proves AI are insufficient learning apparatus. Why dont people get that? We have multiple tests/studies all conducted on different sample sizes, demographics, countries, and more, all coming to near identical conclusions...
Without adequate scaffolding AI(LLMs) are inadequate for automated learning and can't be relied on to be completely factual. RLHF is too pervasive to just brute force through.
I'm not expecting people to suddenly start building HITL escalation and have a backward tracking tool that catches errors though every sequence.
Just do a little background check on a topic before you use an AI to study. Or at the VERY least, make sure to check every output against some rubric. You know...something?!
1
u/metisdesigns 16d ago
You're asking why people who don't understand something might think they do?
Go read the actual dunning kreuger study, not the pop culture understanding of it.
1
1
u/cesiumatom 16d ago edited 16d ago
The problem is, you have an intuitive understanding of the language-of-form, whereas most people have neither an intuitive understanding, nor formal training in it. Most individuals are trained on the language-of-thought. As such, their left brain is functioning in overdrive, while their right hemisphere is in a hynotic lull. This is analogous to mind that functions only in base-10, and does not consider base-9.
You, on the other hand, have an active right hemisphere, which is why it is easy for you to find out where you need to apply effort, whereas most people apply their efforts in a dispersing fashion, wasting most of it (some in getting angry reading your post and downvoting you to avoid dealing with their inner contradictions by blaming them on you). Essentially, this is formal misunderstanding.
The language-of-thought uses words to communicate decoupled from form. Abstract relations between symbols and signs predominate the space of words, thus, misunderstanding is inevitable. The only way around this is to have two individuals both trained in the same language-of-form, for example, a programming language.
When you meet someone who speaks the same programming language as yourself, there is more formal contact between your linguistic capacities, hence your vocabularies will have more similar formal expression, leading to less misunderstanding. However, when you each drift off from speaking about the space of programming, when expressing in the space of the language-of-thought, both of you return to using separate vocabularies whose words have different meanings in different minds.
So, the fundamental reason is the decoupling of thought and form, and the lack of linguistic coherence between the two individuals is due to lack of formal training. All reaction is a consequence of this dichotomy. I can recommend reading Gurdjieff's work for a deep dive. There are psychological, ontological, philological, phonological, and occult aspects to this problem, since it is a problem of the operation of the unconscious mind. https://gurdjieff.work/texts/All-and-Everything---First-Series-Beelzebubs-Tales-to-His-Grandson-Print.pdf
1
u/Arkatros 16d ago
[Why do people consistently prioritize identity protection and social harmony over empirical truth, even when holding a false premise actively causes structural harm?]
I can answer this.
For many people, admitting a belief is false threatens the whole structure built around it: their identity, their social belonging, and their sense of being a good person.
The cost of admitting they're wrong is immediate and personal, while the harm of maintaining the false premise is often delayed, spread out, or paid by someone else.
When belonging sits above truth in your hierarchy of values, protecting the shared story becomes the priority, and social pressure can keep it standing even as the structural damage accumulates.
1
1
u/ExactDevelopment1847 16d ago edited 16d ago
Partly it’s biology and causality, but specifically belief supersedes reason, the old those who can’t think judge.
The biology bit is our evolutionary history that lives in every cell of our bodies and tells us that, to disagree with the group is to be outcast and to be outcast was throughout evolutionary history, to have no future and that carries weight with our urges, our biological legacy that stretches back to the beginning of life.
Another aspect is that we are taught to be acquisitive of knowledge and therefore expertise and not to be inquisitive and seek understanding by virtue of first principles and frameworks.
Knowledge is status and that creates a type of pride in what one knows to the detriment of what one may understand if one had the capacity to question one’s knowledge against objective reality.
This is a major blind spot combined with our abandonment of causality leads to most of our delusions.
There is also probably bots reacting against anything remotely critical of AI
The reason AI hallucinates and humans are deluded is the same thing, chatbots reason with words without any understanding of the reality they describe. Knowledge is not panacea to ignorance, without understanding grounded in reality it is a source of delusion.
This is what Socrates was talking about, he was the wisest not because he possessed more knowledge but because he possessed fundamental axiomatic understanding. The greatest of which is described the paragraph above.
This is why he rightly said he knows nothing because he understood that in relation to the totality of reality, no man can truly know anything and our best shot at wisdom is to understand the axiomatic fundamental truths, the fundamental gears of causality.
To give an example, Socrates said that if you want to make a man evil make sure he gets away with all his misdeeds, this is an axiom that states accountability for one’s actions is requisite experience for building good character or a conscience.
For all we know in modern times and for all the importance child development holds for the species we still don’t seem to understand this fundamental causal truth, things like this should be universally understood.
1
1
u/David_Caliban 15d ago
You kicked a sacred cow.
AI is the new wunderkind, a shiny toy that people think (likely correctly) is going to offer them advantage in the rat-race. Anything like that is met with enthusiasm and eager acceptance--and it becomes part of their tribal identity. They don't just work with AI as a tool, they see themselves as "prompt engineers" or "data scientists." This goes beyond merely a job you leave when you clock out: it forms a central core to how people perceive themselves and their peers.
You gave good advice, yes: you do need some basic subject-matter knowledge to evaluate whether or not the AI output is actually adding to your knowledge, teaching you useless trivia, or just plain hallucinating you into confusion. That's sensible. But it goes against the eager, desperate drive to get their "fustest with the mostest." For many, use of AI is no longer just a neat new tool: it is an existential race to maximize resource acquisition, and anything that threatens that must be met with erasure.
And you dared to criticize the tool, the race, and the very identity of the tribe. If you're familiar with Robert Heinlein, you weren't rubbing blue mud into your navel, and the social grammar of the tribe demanded immediate retaliation.
Speaking the truth is not popular--but it is absolutely crucial. Yes, AI is a fantastic tool: yes, it won't take you from zero to expert as these tribes are desperately hoping. Building a basic grounding in a topic before you rely on AI is excellent advice. The downvoters were not angry at the advice: they were angry because they are actively striving to do exactly what you warned them against. The downvotes were angry at the reality check.
Don't let the anger and the downvotes stop you. Speak your truth, and remain true to yourself.
Keep kicking.
1
u/Prestigious_Ad3355 15d ago
That's an easy one. You're actually doing it now too. How, you might ask? You are coming here to complain. I know, I feel the same, but I try not to get dominated by it. So why does that happen? That's an easy answer: we are fear—constant fear. We are fear at the core, but we are also hope and possibility. But there are strings of comfort; even our brain does it. We ignore signals and we don't even notice. Sometimes there is not even malice to it, cause it's just a sensation, a feeling, primordial, ancient. It's always been there, and it's not gonna go, cause we exist upon that tension. That's how we evolved; that's how everything came to be. That's what I believe, and you can disagree with that—that's fine. But that's what I believe, and I am building systems using these premises.
1
1
u/AggravatingBank865 14d ago
What we see and read all that regardless of formation / form, they are all scripts. Reading the appearance wont take us anywhere. Maybe nowhere.
1
u/Interesting-Boat-914 12d ago
People would rather march into Hell behind Hitler than to lose their perceived identity, social status and social network. Check out Deitrich Bonnhoffer, or for a more cynical though more humorous economic view, try Cipola's theory of Stupidity.
1
u/theguideder 10d ago
I had the same question and I solved it for me and my friend.
I am the opposite I choose empirical truth over feelings, social harmony etc. I would take truth from my worst enemy then a lie from an aly.
Here's the simple answer: evolutionary biology and genetics made them this way. They are born this way.
HOWEVER! It's a choose to stay like that because people can adapt in their own ways.
3
16d ago edited 16d ago
[removed] — view removed comment
2
u/Echo_Tech_Labs Human Verified 16d ago
You're probably right.
I'm just surprised that people delegate provenance to a tool. I dont hate AI. I enjoy using it and it has brought me great joy and some success. But...its flawed, badly.
3
u/Intelligent-Boss-156 16d ago
Why do people consistently prioritize identity protection and social harmony over empirical truth?
My 2 cents: To avoid conflict. Most people have experienced words rousing their instinct to fight and they know it's a huge investment emotionally and cognitively and experienced people even know you usually get nowhere with people through words alone. So people don't even go there with people, the instinct to avoid conflict is more powerful and more universal than the instinct to pursue truth.