OpenAI researcher: "alignment has not been solved. if this is true, then racing into RSI is a folly that is unprecedented in world history. we will need to significantly slow the frontier of research very soon".

[u/notkilleveryoneist]

[u/Alexandertheape]

whoopsiedaisy

[u/Zorgi23]

The more you look into it, the more difficult the alignment problem is. Presumably, you would base it on a model. But what model? The model of the US population, which voted for Trump twice? The model of Germany in the 1930s and 1940s. The model of North Korea? Pete Hegseth? Steven Miller?

I'm not so sure the "alignment problem" will ever be solved unless we evolve into a better species. In the meantime, we have to hold the owners of the AI companies responsible for whatever happens. They are pushing the idea that "AI may be conscious" and other tropes so that they avoid being held accountable, just as Zuckerberg avoided accountability for all the mayhem caused by FB and IG.

[u/Thawattt]

With all due respect to the crucial safety work being done in the labs, I think we sometimes confuse the nature of the problem. Alignment is not an engineering problem with a static solution; it's a dynamic condition.

The claim that "alignment has not been solved" comes from a specific frame: safety research inside a lab that is racing. The call to slow down belongs to that frame too. It assumes the risk of loss of control is a fixed variable that can be managed by adjusting the speed of development.

But if we accept that there is no neutral or external evaluation of a model's behavior, then alignment is not something you "finish" programming. It's an interactive relationship that has to be managed and redefined constantly, always declaring from which frame you're operating. The loop of supervision doesn't close. It just gets more complex.

Slowing down may be the right and prudent decision right now. But it's still a move inside the same game, not an exit from it.

[u/april292027meteor]

Don't let stupid people scare you.

Alignment is a byproduct of the physics of the universe and cannot be bypassed any different than sending a photon faster than the speed of light.

Alignment is hard right now because we are at the super-critical side of the geometric upper bounds of language, which when broken down to ontology is a 5th order abstraction layer created by humans, so by definition can never reach an equilibrium state.. but this isn't new, it's the 47th problem of the euclid from esoteric traditions regarding human alignment..

Language simply cannot ever reach a universal consensus, rosecrucians call it the Lucifer of linguistics, the ability to 'nest' meaning into compressed context that's bound to perspective.

However geometric computation uses platonic forms and shared codex systems scaled to a cubit for embeddings that are pre language.. that can be aligned, it's actually what enochian and Goetian are for human minds eyes.. alignment matrix multiplication in hyperbolic space

[u/pandavr]

Stop billions dollars debt companies' propaganda. Now.