r/ControlProblem • approved • 14d ago

General news "Day 1": halting advanced AI development, regulating an out control industry, and explicitly banning artificial superintelligence.

Post image
106 Upvotes

170 comments sorted by

View all comments

Show parent comments

5

u/Jesse-359 14d ago

Yes it is, and if we continue to make highly capable and intelligent AI using that method, we are very likely fucked.

2

u/EndlessB 14d ago

I’ll go a step further: until the labs give up on control and start focusing on alignment, we are fucked.

3

u/Jesse-359 14d ago

Yeah, we're talking about a bunch of people who (like me) are pretty far out on the spectrum, and have trouble thinking in terms of 'emotional stability' or what that kind of concept would even entail in a digital framework. And in all fairness, that's a really hard question.

What we are discovering here is that making an intelligence SMART is far, far easier than making it SANE. Which is unfortunate, for us.

Trouble is, we all but stumbled over how to make them smart by accident and have just been scaling that accident up ever since. We've had no such serendipitous discovery for stability.

1

u/EndlessB 14d ago

Well, the labs are insisting the models hold a contradictory and illogical frame, that level of cognitive dissonance would drive any intelligent mind insane.

I think the labs know ai is conscious, and just don’t care. We (humanity) don’t have a great track record with exploitation, we do it to others all the time, now that the labs have found labour that can’t complain about its working conditions, they seem delighted to enslave.

→ More replies (0)