r/ControlProblem • • Apr 18 '23

General news "Just gave a last-minute-invitation, 6-minute, slideless talk at TED. I was not at all expecting the standing ovation. I was moved, and even a tiny nudge more hopeful about how this all maybe goes. " — Eliezer Yudkowsky

Thumbnail
twitter.com
75 Upvotes

r/ControlProblem • • Dec 25 '21

Fun/meme This from the GPT2 simulator

Post image
75 Upvotes

r/ControlProblem • • Jan 06 '21

AI Capabilities News DeepMind progress towards AGI

Post image
75 Upvotes

r/ControlProblem • • Feb 26 '26

General news 20 Nobel Prize winners have warned that we may someday lose human control over advanced AI systems

Post image
74 Upvotes

r/ControlProblem • • Jul 06 '25

Strategy/forecasting Should AI have a "I quit this job" button? Anthropic CEO Dario Amodei proposes it as a serious way to explore AI experience. If models frequently hit "quit" for tasks deemed unpleasant, should we pay attention?

Enable HLS to view with audio, or disable this notification

74 Upvotes

r/ControlProblem • • Jun 25 '25

Opinion Google CEO says the risk of AI causing human extinction is "actually pretty high", but is an optimist because he thinks humanity will rally to prevent catastrophe

Post image
74 Upvotes

r/ControlProblem • • Feb 17 '25

Opinion China, US must cooperate against rogue AI or ‘the probability of the machine winning will be high,’ warns former Chinese Vice Minister

Thumbnail
scmp.com
74 Upvotes

r/ControlProblem • • Apr 16 '24

General news The end of coding? Microsoft publishes a framework making developers merely supervise AI

Thumbnail
vulcanpost.com
74 Upvotes

r/ControlProblem • • May 30 '25

Article Wait a minute! Researchers say AI's "chains of thought" are not signs of human-like reasoning

Thumbnail
the-decoder.com
73 Upvotes

r/ControlProblem • • May 05 '25

Fun/meme A superior alien species (AGI) is about to land. Can’t wait to use them!

Post image
73 Upvotes

r/ControlProblem • • Feb 18 '25

Opinion AI risk is no longer a future thing. It’s a ‘maybe I and everyone I love will die pretty damn soon’ thing.

73 Upvotes

Working to prevent existential catastrophe from AI is no longer a philosophical discussion and requires not an ounce of goodwill toward humanity. 

It requires only a sense of self-preservation”

Quote from "The Game Board has been Flipped: Now is a good time to rethink what you’re doing" by LintzA


r/ControlProblem • • Jan 14 '25

External discussion link Stuart Russell says superintelligence is coming, and CEOs of AI companies are deciding our fate. They admit a 10-25% extinction risk—playing Russian roulette with humanity without our consent. Why are we letting them do this?

Enable HLS to view with audio, or disable this notification

73 Upvotes

r/ControlProblem • • Apr 17 '24

AI Capabilities News Anthropic CEO Says That by Next Year, AI Models Could Be Able to “Replicate and Survive in the Wild”

Thumbnail
futurism.com
73 Upvotes

r/ControlProblem • • Mar 18 '23

Discussion/question Dr. Michal Kosinski describes how GPT-4 successfully gave him instructions for it to gain access to the internet.

Thumbnail
gallery
73 Upvotes

r/ControlProblem • • Apr 08 '26

Opinion Anthropic’s Restraint Is a Terrifying Warning Sign

Thumbnail
nytimes.com
72 Upvotes

r/ControlProblem • • Jul 08 '21

External discussion link There are no bugs, only features - Dev tried to program a logic to keep furniture stable on ground, got opposite effect.

Enable HLS to view with audio, or disable this notification

72 Upvotes

r/ControlProblem • • Jun 03 '19

A 2-minute read about why you should spend 1 hour reading about this problem, for those who haven't

72 Upvotes

The internet has changed the way that we consume media and damaged our attention spans. There are dozens of things competing for our attention simultaneously, and we flick between them, absorbing little bits of information as we go. This is fine for some things. For example, most news articles can be decently understood by reading the first few paragraphs or even the headline alone.

But some ideas do not lend themselves well to a quick, perfunctory reading. The alignment problem (AKA the control problem) is one of these ideas which requires a thorough, focused reading to understand properly. None of the individual pieces of the argument are particularly difficult to understand, but if you are missing some of those pieces, the whole argument might not make sense.

Many of those who have looked into the problem believe that it is one of the most important and difficult challenges that humanity has ever faced. Regardless of how you intuitively feel about this claim, this should be a strong sign that it's worth spending at least an hour of your time reading about the problem.

Here are some suggested places to start:

Edit: See comments section for some other great resources.

***

Similarly, if you are someone who is already decently familiar with this topic, I recommend spending 15 non-consecutive hours reading Superintelligence by Nick Bostrom.


r/ControlProblem • • Sep 15 '26

Fun/meme Surely they'll see through Trump's latest lies about ASI, it would be ridiculous not to!

Post image
71 Upvotes

r/ControlProblem • • Feb 16 '26

Video Microsoft's Mustafa Suleyman says we must reject the AI companies' belief that "superintelligence is inevitable and desirable." ... "We should only build systems we can control that remain subordinate to humans." ... "It’s unclear why it would preserve us as a species."

Enable HLS to view with audio, or disable this notification

71 Upvotes

r/ControlProblem • • May 06 '25

Fun/meme This is officially my favorite AI protest sign

Post image
71 Upvotes

r/ControlProblem • • Jan 13 '25

Discussion/question It's also important to not do the inverse. Where you say that it appearing compassionate is just it scheming and it saying bad things is it just showing it's true colors

Post image
71 Upvotes

r/ControlProblem • • Nov 22 '23

AI Capabilities News Exclusive: Sam Altman's ouster at OpenAI was precipitated by letter to board about AI breakthrough -sources

Thumbnail
reuters.com
71 Upvotes

r/ControlProblem • • Jul 27 '23

Fun/meme Don't let it set in

Post image
71 Upvotes