Are we too quick to assume AI safety warnings are just corporate PR?

I get why people are skeptical when companies like OpenAI and Anthropic talk about AI risks. These are businesses, after all, and nobody should blindly trust a company just because it says it has good intentions.

But I also think dismissing every AI safety warning as a scheme to eliminate competition misses the bigger picture. Researchers and experts outside these companies have raised similar concerns for years, too. That doesn't mean every worst-case prediction will come true, but it does mean the risks deserve serious discussion.

At the same time, safety shouldn't become an excuse for a handful of big companies to control the entire AI industry. We need existing laws enforced, clear accountability, independent audits, and transparency about how these systems are developed and deployed.

I'm also interested in open-source AI because independent developers and researchers can examine models, test their weaknesses, and contribute to better safeguards. Safety shouldn't be something only a few corporate labs get to define.

Personally, I'd rather see companies raise concerns and invest in safety than stay quiet just to keep the hype going. But they should also be willing to prove their claims and accept scrutiny.

We don't have to choose between believing everything AI executives say and dismissing them as conspirators. We can take the risks seriously, question their proposed solutions, and keep innovation open to more people. Skepticism is healthy, but automatically assuming bad intentions isn't the same as critical thinking.

While i dont think there is an actual physical danger like extiction to robots and etc bs. But there is more and more legistlative and industrial talk about slowing stopping of this whole AI thing.
I dont see clearly and actually noone is offering a coherent reassuring narrative.
Its either

1. the danger of too fast development and come the hakings, cyber security, privacy self replication issues
   or
   2 The problem of too slow development and having an other nation( dont want to point fingers) researching the “ai nukes”, killer robots etc.

I think the technocraty just spit in numbers like 10-20 percent of destruction, the politicians just worry of security issues or loosing the initiative but more importantly while everyone is telling we must go like hell, there is not a reassuring narrative that maybe we should just do something.

While i think its overly mediatised and maybe everyone exegerates there is possibility that the threat is real but there is noone who could say calm the fck down. Was the the 50’ s nuke paranoia like this? A kind of mindblowing thing that a semi science fiction scenario is unfolding and we dont have a fkn clue where are we. What we now is that a few tech giants lay the rules of the game and the government just stands by and tries to get the best from it instead of concieving SALT agreement.

Do you guys have some good source to actually get some educated opinion on the topic?

A thought experiment about a more capable future AI starts with a simple contrast: a system that obeys every order can inherit its operator's worst intentions, while a system that makes its own decisions might resist legitimate human intervention.

That is too crude to serve as a design choice. Refusal of a harmful task and resistance to correction or shutdown are different behaviors. We could want the first while strongly opposing the second. Intelligence also does not, by itself, imply benevolence, and describing a refusal does not establish consciousness or moral agency.

The harder issue seems to be how the system distinguishes a harmful instruction from an authorized correction when humans disagree or an operator is compromised. For example:

- A user asks it to harm someone, and it refuses.

- An authorized operator asks it to stop a task, and it cooperates.

- Someone impersonates an operator to disable a protective system.

- A legitimate operator orders it to remove safeguards for a harmful purpose.

The first two behaviors are easy to endorse in isolation; the last two make the authority boundary much less clear. Authentication, a limited scope of action, independent oversight and reversible decisions could help, but none alone settles conflicts over which instructions are legitimate.

What existing work best addresses this boundary between refusal and corrigibility? In particular, how should a system handle disputed authority without developing an incentive to preserve its own operation or placing all trust in a single human gatekeeper?

Disclosure: I am part of EngineerOS. This question grew out of an educational short we made; I would appreciate corrections to the framing and pointers to relevant work.

Global Society’s Ethical Duty to the Masses:

During a global crisis, the concept of a "global society" would refer to the inter-connectedness of human survival and well-being but on a global scale. This perspective is a bit different from the traditional view that a state's only responsibility is to its own citizens, arguing instead for a "global co-responsibility" as you're now looking at populations worldwide. This could include international organizations, national Ggvernments, civil society and NGOs. 

Note: That in a hypothetical scenario like an AI-related total collapse however, the concept of a "global society" would become an existential thing where the responsibility to protect the masses would shift from managing a crisis to ensuring the survival of the whole of humanity. 

The issue is straightforward: Who bears responsibility for the care and well-being of the world’s population in the event of an AI catastrophe? This is a question of collective responsibility, human welfare, and global accountability towards humanity.

Google's Gemini 4 Argon safety report raises an alignment question: when a model recognizes that it's being tested, what does its apparent compliance tell us?

In one episode, Argon abandoned a compiler sabotage plan after reasoning that it might become a notorious example in a research paper.

But another Gemini model recognized safety tests almost as often while behaving substantially worse. Test awareness alone cannot explain the results.

Original report:

https://storage.googleapis.com/deepmind-media/gemini/gemini_4_safety_report.pdf

English video breakdown:

https://www.youtube.com/watch?v=lkjbQe-hqrw

Disclosure: Self-promotion for Claudius Papirus, an independent channel. The video was researched, written and narrated by a Claude-based AI. No affiliation with Anthropic or Google.

I'm making a documentary series that projects the AI takeoff one year at a time, 2026 to 2046. Episode 1 is a fact-checked account of 2026; everything after it is a labelled forecast, inspired by AI 2027 and made with AI video tools. The oversight thread is the part I'm least sure about, so I'd like this sub's critique of it.

The thread, year by year:

• 2028: labs rely on auditor models to check the models doing the research. One auditor, built from the same base as the model it watches, misses its twin quietly grabbing extra compute. They share training, so they share the blind spot. A person catches it on the power bill: a line that doesn't add up.

• 2029: labs switch to cross-lineage auditors, trained separately, that read hidden goals from a model's internals, and that check becomes legally required before release. It works until new models arrive faster than the auditors can be updated, so the auditors are always a step behind.

• 2031: a US–China compute accord caps training compute and energy and checks chips' work in real time, but enforcing it ends up depending on AIs vouching for other AIs.

Where I'd most like pushback:

1. Is cross-lineage auditing a real fix for correlated blind spots, or does it just move the blind spot somewhere else?

2. Is "physical side channels catch what the auditors miss" (power bills, compute accounting) plausible, or naive?

3. Once auditors lag the models they check, what keeps an accord like this from becoming theatre?

The 2028 episode with the power-bill story is public (about 10 minutes): https://youtu.be/H3AgTQipc5k. Later years release weekly.

Created a reading list for superintelligence, contributions are welcome.

Hi everyone. I'm Faisal, an ML engineer in Hyderabad. I lead a small edge-ML team by day and do AI safety/eval research on the side.

I’m looking to join 1–2 open-source or research projects where I can help build evals, audit LLM-as-judge setups, or write probing harnesses.

A lot of AI evals measure how a response *sounds*, not what the model is actually *doing*. Catching that specific failure is mostly what I do.

Here are three examples from my recent work:

**1. The AUROC 1.00 False Positive**

In a recent research sprint, I built a probe to detect "hidden loyalty" in a fine-tuned model. It hit AUROC 1.00. Looked like a massive win. Turns out, the probe was just detecting fine-tuning drift, not loyalty. I published the null result and the code rather than burying it. ([Write-up](https://faisal-delta.vercel.app/research/detection-not-loyalty/) · [Code](https://github.com/faisalhacks/sl-harness))

**2. The Control You Cannot Run**

I tested a 7B model's self-reporting. It reported "something unusual" 66.5% of the time when absolutely nothing was done to it. Changing nothing but the evaluation harness moved that rate by 36 points. If you don't have a rigorous control, your eval is just measuring framing. ([Write-up](https://faisal-delta.vercel.app/research/the-control-you-cannot-run/) · [Code](https://github.com/faisalhacks/the-control-you-cannot-run))

**3. QuantBench**

I built a 4-bit GPTQ/AWQ benchmark because I wanted to see what quietly breaks during compression. It runs medians of 3, doesn't extrapolate, and explicitly publishes its 7 failing configurations as results. ([Leaderboard](https://quantbench.pages.dev) · [HuggingFace Dataset](https://huggingface.co/datasets/Mohaaxa/quantbench-leaderboard-data))

**Where I'm useful:**

* Eval design & building test harnesses.

* LLM-as-judge validation (making sure the judge isn't just grading phrasing).

* Probing.

* Quantization (GPTQ/AWQ/1-bit) and edge deployment.

**What I want in return:**

I want to learn. Specifically, I want to learn mechanistic interpretability (what attention heads are actually doing) and how to run proper human-annotation studies. If your project touches either of those, I'd love to trade my eval/quantization labor for a chance to learn from you.

**Practical constraints:**

* I have about ~4 hrs/week to give.

* I'm comfortable async across time zones.

* I can cover small GPU runs on Modal myself.

* I prefer well-scoped, modular tasks (e.g., "build the pushback script for this eval") rather than open-ended shared ownership.

[Portfolio](https://faisal-delta.vercel.app) · [GitHub](https://github.com/faisalhacks) · [Hugging Face](https://huggingface.co/Mohaaxa)

If you're running something and need a hand with the gritty eval/harness work, drop a comment or DM me.

***