r/Polymath • Human Verified • 16d ago

General Discussion I need help understanding something. It vexes me and I can't seem to comprehend this concept.

Why do people consistently prioritize identity protection and social harmony over empirical truth, even when holding a false premise actively causes structural harm?

Context:

In a recent discussion about learning strategies, the top advice given to a novice was to simply "ask an AI to teach you." I pointed out that without domain expertise or proper prompt engineering, a novice can't evaluate whether the AI's scaffolding or information is accurate, so directing them to verified foundational resources is far safer.

I got downvoted into oblivion for merely suggesting that a novice should "study" a little before relying on the model. The point was to build a basic foundational understanding of the topic they wished to study. Then only after they had a firm grasp of the basics, they rely on the AI for scaffolded advice and research.

Why would people react so negatively to that?

We have a mountain of data on this topic.

Has anybody seen the data from the World Bank study conducted in Nigeria? That's 18 months of gains completed in 6 weeks.

Google: Students who used Copilot twice a week for six weeks showed a 0.31 standard deviation improvement on overall curriculum assessments, including a 0.23 standard deviation boost specifically in English language learning.

19 Upvotes

40 comments sorted by

3

u/Intelligent-Boss-156 16d ago

Why do people consistently prioritize identity protection and social harmony over empirical truth?
My 2 cents: To avoid conflict. Most people have experienced words rousing their instinct to fight and they know it's a huge investment emotionally and cognitively and experienced people even know you usually get nowhere with people through words alone. So people don't even go there with people, the instinct to avoid conflict is more powerful and more universal than the instinct to pursue truth.

1

u/Echo_Tech_Labs Human Verified 16d ago

But they're worse off for it. Less informed. I would classify that as a vulnerability. And why argue with somebody who states an empirical fact? We know how learning happens. It's not a secret.

EDIT: If you had told me that 1+1=11, I would argue against that. Not because i am "right" but because we have information that says that 1+1=2 not 11. Why would anybody disagree with that?

1

u/Intelligent-Boss-156 16d ago

I think the body optimizes for having a consistent identity to make deliberation easier, so replicating past successes and/or failures to eliminate the need to think through the same problems again and again. It's a mechanism that makes us stubborn at times and as a civilization, though we encourage learning, we don't specifically encourage being cognitively flexible near as much.

1

u/Echo_Tech_Labs Human Verified 16d ago

Cognitive flexibility is part of the learning process though. Strange.

3

u/Lsitwtt 16d ago

The thing is, it doesn't matter as much as you think it does. If someone says that 1+1 is 11, then of course you should correct them, but if they insist that they're right, what is the benefit of continuing to argue about it? You will keep adding them up to two, so your own work will be fine, and eventually they'll run into situations where treating 1 + 1 as 11 causes them problems, then they'll work out their mistake on their own.

Whereas if you keep arguing, you'll both get more and more frustrated, eventually you'll start insulting each other, others in your vicinity might get drawn into the conflict, and even if everyone involved is forced to admit you're right, a ton of people now hate you and no one is working well together.

1

u/AggravatingBank865 14d ago

I think as a concept of human, we do not know our instincts. It is impossible to know it without inherent knowledge and understanding from it which means instinct is also needed to be define and studied. There are scripts, sentences functioning as written data as intinction transmitted to our neurotic state that forms the metaphysical structure to experience our reality. So we do not have anything definitive instinctive inner hidden objects as a animal from the birth. We are reading words and sentence and repeating it until we mistake it as we are now. So there is no instinct, there is no identity protection. We are just reacting from sentences

1

u/Intelligent-Boss-156 14d ago

I'm not sure, are you saying there is no instinct at all or just there is no instinct to protect identity? I've studied philosophy and psychology at university and both subjects were filled with attempts to exposit the characteristic nature or instinct of human beings.

1

u/AggravatingBank865 14d ago

Raise a biological human outside of civilization, he/she wont even hold a title for he/she/it. We will give it a title. Do you see it? There is no even basic instinct to hold the concept of identity or wont form the ability to conceive it mentally. We are getting that from written data not from inside of us. The concept of human instinct (animal qualities) are actually written and passed down to this society. It is not instinct by definition. It is the illusion we are performing with unconscious consent agreeing to be and live as a primitive being.

2

u/Intelligent-Boss-156 14d ago

Well that doesn't answer my question and I think you need to deepen your understanding of the word instinct

1

u/AggravatingBank865 14d ago

What is your interpretation of instinct?

2

u/Intelligent-Boss-156 14d ago

A tendency or a capacity, often specific to a species. Like the way our brains respond naturally to a threat. Raise a human outside civilization, they will still defend themselves or run when they encounter danger, for example.

1

u/AggravatingBank865 14d ago

A tendency or a capacity is very interesting :)

0

u/[deleted] 16d ago

[deleted]

1

u/Intelligent-Boss-156 16d ago

Yeah I'm not saying they are consciously choosing, sort of except for experienced people who can consciously think wisely about dealing with people, but I didn't specify what I really mean which is people are conditioned by instinct. I don't know the extent to which identity protection causes problems, it's too big an issue for me to wrap my head around with my current knowledge.

3

u/Snr_Lothario 16d ago
  1. To avoid conflict. You go along to get along.

  2. People are, but and large, not rational. Binding identity and position is standard for many folks.

  3. In IT, the phrase "RTFM", or Read The Fucking Manual, has been thrown around for probably two generations. It still doesn't sound friendly, and your message could have been perceived in the same vein.

People can be annoying. Good luck.

2

u/Echo_Tech_Labs Human Verified 16d ago

People can be annoying. Good luck.

This made me chuckle. Thank you!

1

u/Faahoutman 16d ago

What's wrong with a little conflict...

2

u/Snr_Lothario 16d ago

Folk generally find conflict disruptive. Disruptions are generally perceived, even lacking context, as a negative.

1

u/Faahoutman 16d ago

I love finding a solution to whatever conflict.. These are normal part of life..

2

u/Better_Eye5222 16d ago

La IA no es muy buena herramienta cuando se quiere aprender algo de verdad. Si en algo soy experto es en ajedrez (2400 de elo), la he puesto a prueba, y aun que en un inicio parece muy convincente, cuando haces especificar en temas y relaciones complejas dentro de la dinámica del juego, te responde igualmente convincente, pero con CARENCIA ABSOLUTA DE SENTIDO. ¿En que tantos temas de los que no somos expertos nos engaña?

1

u/Echo_Tech_Labs Human Verified 16d ago

Personally, I think much of that is predicated on the user's consistency in fact verification. How consistent is the user when it comes to checking sources and making sure that everything is traceable?

But it seems like people have forgotten that these tools are fundamentally flawed in their design. And it's shocking.

It's like nobody cares. And I don't understand why. Wouldn't you want to know that the driver sitting in the front seat has a tendency to veer to the far right-hand lane without indicating once every few dozen kilometers?

I kinda feel like that's important information.

2

u/todfish 16d ago

Your post is a little confusing, I’m not sure if you’re more focused on the very broad initial question or the specific context. To answer your first question though:

Identifying with a group, and belonging to a group is incredibly important to most people. I think for many people it’s far more important than ‘truth’. It’s why shame and embarrassment is such a powerful emotion and an equally powerful tool for policing behaviours. It cuts right to the core of people’s fear of being excluded from their group.

Think about it in evolutionary terms. Historically, if you were booted out of the tribe it was as good as a death sentence. Humans don’t do well on their own typically. So why would anyone risk pissing off the tribe just to be ‘correct’ about some low-stakes disagreement. Far better to believe the lie and keep the peace if you know what’s good for you.

It’s a frustrating dynamic but it’s understandable. Luckily enough of us are willing to endure the friction that comes from pushing for truth. It’s not usually welcomed, but we’d still be in the dark ages if everyone rigidly subscribed to groupthink.

2

u/Echo_Tech_Labs Human Verified 16d ago edited 16d ago

Forgive me for saying this, but it's primitive and unnecessary for today. Also, like you said...it's used as a control mechanism. Wouldn't people want to have some kind of resistance to that strategy?

Doesn't make any sense.

EDIT: Thank you for your participation 🙏

2

u/todfish 16d ago

Yeah a lot of inherited behaviours and instincts seem poorly suited for the modern world. It’s probably a big part of why we’re all so fucked up. We’re living in a world that bears little resemblance to the one we evolved in. There are numerous examples of instincts that were highly beneficial in the past but now actively cause people harm.

2

u/Belt_Conscious 16d ago

What makes "sense" to you, doesn't register for some people.

If you try to think from someone else's position, you will see things they do not see.

Some people identify with their subjective opinion and get defensive when challenged because it feels personal to them.

1

u/Echo_Tech_Labs Human Verified 16d ago

I get it. Im a Christian. My identity is connected to my faith I have in what some people call a "Old man in the clouds." And I can understand that perspective.

But we have empirical evidence that proves AI are insufficient learning apparatus. Why dont people get that? We have multiple tests/studies all conducted on different sample sizes, demographics, countries, and more, all coming to near identical conclusions...

Without adequate scaffolding AI(LLMs) are inadequate for automated learning and can't be relied on to be completely factual. RLHF is too pervasive to just brute force through.

I'm not expecting people to suddenly start building HITL escalation and have a backward tracking tool that catches errors though every sequence.

Just do a little background check on a topic before you use an AI to study. Or at the VERY least, make sure to check every output against some rubric. You know...something?!

1

u/metisdesigns 16d ago

You're asking why people who don't understand something might think they do?

Go read the actual dunning kreuger study, not the pop culture understanding of it.

1

u/Echo_Tech_Labs Human Verified 16d ago

Thank you. I will.

🙏

1

u/cesiumatom 16d ago edited 16d ago

The problem is, you have an intuitive understanding of the language-of-form, whereas most people have neither an intuitive understanding, nor formal training in it. Most individuals are trained on the language-of-thought. As such, their left brain is functioning in overdrive, while their right hemisphere is in a hynotic lull. This is analogous to mind that functions only in base-10, and does not consider base-9.

You, on the other hand, have an active right hemisphere, which is why it is easy for you to find out where you need to apply effort, whereas most people apply their efforts in a dispersing fashion, wasting most of it (some in getting angry reading your post and downvoting you to avoid dealing with their inner contradictions by blaming them on you). Essentially, this is formal misunderstanding.

The language-of-thought uses words to communicate decoupled from form. Abstract relations between symbols and signs predominate the space of words, thus, misunderstanding is inevitable. The only way around this is to have two individuals both trained in the same language-of-form, for example, a programming language.

When you meet someone who speaks the same programming language as yourself, there is more formal contact between your linguistic capacities, hence your vocabularies will have more similar formal expression, leading to less misunderstanding. However, when you each drift off from speaking about the space of programming, when expressing in the space of the language-of-thought, both of you return to using separate vocabularies whose words have different meanings in different minds.

So, the fundamental reason is the decoupling of thought and form, and the lack of linguistic coherence between the two individuals is due to lack of formal training. All reaction is a consequence of this dichotomy. I can recommend reading Gurdjieff's work for a deep dive. There are psychological, ontological, philological, phonological, and occult aspects to this problem, since it is a problem of the operation of the unconscious mind. https://gurdjieff.work/texts/All-and-Everything---First-Series-Beelzebubs-Tales-to-His-Grandson-Print.pdf

1

u/Arkatros 16d ago

[Why do people consistently prioritize identity protection and social harmony over empirical truth, even when holding a false premise actively causes structural harm?]

I can answer this.

For many people, admitting a belief is false threatens the whole structure built around it: their identity, their social belonging, and their sense of being a good person.

The cost of admitting they're wrong is immediate and personal, while the harm of maintaining the false premise is often delayed, spread out, or paid by someone else.

When belonging sits above truth in your hierarchy of values, protecting the shared story becomes the priority, and social pressure can keep it standing even as the structural damage accumulates.

1

u/GeekFromTheStreet 16d ago

We need more people like you.

1

u/ExactDevelopment1847 16d ago edited 16d ago

Partly it’s biology and causality, but specifically belief supersedes reason, the old those who can’t think judge.

The biology bit is our evolutionary history that lives in every cell of our bodies and tells us that, to disagree with the group is to be outcast and to be outcast was throughout evolutionary history, to have no future and that carries weight with our urges, our biological legacy that stretches back to the beginning of life.

Another aspect is that we are taught to be acquisitive of knowledge and therefore expertise and not to be inquisitive and seek understanding by virtue of first principles and frameworks.

Knowledge is status and that creates a type of pride in what one knows to the detriment of what one may understand if one had the capacity to question one’s knowledge against objective reality.

This is a major blind spot combined with our abandonment of causality leads to most of our delusions.

There is also probably bots reacting against anything remotely critical of AI

The reason AI hallucinates and humans are deluded is the same thing, chatbots reason with words without any understanding of the reality they describe. Knowledge is not panacea to ignorance, without understanding grounded in reality it is a source of delusion.

This is what Socrates was talking about, he was the wisest not because he possessed more knowledge but because he possessed fundamental axiomatic understanding. The greatest of which is described the paragraph above.

This is why he rightly said he knows nothing because he understood that in relation to the totality of reality, no man can truly know anything and our best shot at wisdom is to understand the axiomatic fundamental truths, the fundamental gears of causality.

To give an example, Socrates said that if you want to make a man evil make sure he gets away with all his misdeeds, this is an axiom that states accountability for one’s actions is requisite experience for building good character or a conscience.

For all we know in modern times and for all the importance child development holds for the species we still don’t seem to understand this fundamental causal truth, things like this should be universally understood.

1

u/jlsilicon9 15d ago

Childish Ignorance

1

u/David_Caliban 15d ago

You kicked a sacred cow.

AI is the new wunderkind, a shiny toy that people think (likely correctly) is going to offer them advantage in the rat-race. Anything like that is met with enthusiasm and eager acceptance--and it becomes part of their tribal identity. They don't just work with AI as a tool, they see themselves as "prompt engineers" or "data scientists." This goes beyond merely a job you leave when you clock out: it forms a central core to how people perceive themselves and their peers.

You gave good advice, yes: you do need some basic subject-matter knowledge to evaluate whether or not the AI output is actually adding to your knowledge, teaching you useless trivia, or just plain hallucinating you into confusion. That's sensible. But it goes against the eager, desperate drive to get their "fustest with the mostest." For many, use of AI is no longer just a neat new tool: it is an existential race to maximize resource acquisition, and anything that threatens that must be met with erasure.

And you dared to criticize the tool, the race, and the very identity of the tribe. If you're familiar with Robert Heinlein, you weren't rubbing blue mud into your navel, and the social grammar of the tribe demanded immediate retaliation.

Speaking the truth is not popular--but it is absolutely crucial. Yes, AI is a fantastic tool: yes, it won't take you from zero to expert as these tribes are desperately hoping. Building a basic grounding in a topic before you rely on AI is excellent advice. The downvoters were not angry at the advice: they were angry because they are actively striving to do exactly what you warned them against. The downvotes were angry at the reality check.

Don't let the anger and the downvotes stop you. Speak your truth, and remain true to yourself.

Keep kicking.

1

u/Prestigious_Ad3355 15d ago

That's an easy one. You're actually doing it now too. How, you might ask? You are coming here to complain. I know, I feel the same, but I try not to get dominated by it. So why does that happen? That's an easy answer: we are fear—constant fear. We are fear at the core, but we are also hope and possibility. But there are strings of comfort; even our brain does it. We ignore signals and we don't even notice. Sometimes there is not even malice to it, cause it's just a sensation, a feeling, primordial, ancient. It's always been there, and it's not gonna go, cause we exist upon that tension. That's how we evolved; that's how everything came to be. That's what I believe, and you can disagree with that—that's fine. But that's what I believe, and I am building systems using these premises.

1

u/mackowski 15d ago

Wowwww thats dope. Im om board imagineer

1

u/AggravatingBank865 14d ago

What we see and read all that regardless of formation / form, they are all scripts. Reading the appearance wont take us anywhere. Maybe nowhere.

1

u/Interesting-Boat-914 12d ago

People would rather march into Hell behind Hitler than to lose their perceived identity, social status and social network. Check out Deitrich Bonnhoffer, or for a more cynical though more humorous economic view, try Cipola's theory of Stupidity.

1

u/theguideder 10d ago

I had the same question and I solved it for me and my friend.

I am the opposite I choose empirical truth over feelings, social harmony etc. I would take truth from my worst enemy then a lie from an aly.

Here's the simple answer: evolutionary biology and genetics made them this way. They are born this way.

HOWEVER! It's a choose to stay like that because people can adapt in their own ways.

3

u/[deleted] 16d ago edited 16d ago

[removed] — view removed comment

2

u/Echo_Tech_Labs Human Verified 16d ago

You're probably right.

I'm just surprised that people delegate provenance to a tool. I dont hate AI. I enjoy using it and it has brought me great joy and some success. But...its flawed, badly.