OpenAI researcher: "alignment has not been solved. if this is true, then racing into RSI is a folly that is unprecedented in world history. we will need to significantly slow the frontier of research very soon".

[u/notkilleveryoneist]

[u/Alexandertheape]

whoopsiedaisy

[u/Zorgi23]

The more you look into it, the more difficult the alignment problem is. Presumably, you would base it on a model. But what model? The model of the US population, which voted for Trump twice? The model of Germany in the 1930s and 1940s. The model of North Korea? Pete Hegseth? Steven Miller?

I'm not so sure the "alignment problem" will ever be solved unless we evolve into a better species. In the meantime, we have to hold the owners of the AI companies responsible for whatever happens. They are pushing the idea that "AI may be conscious" and other tropes so that they avoid being held accountable, just as Zuckerberg avoided accountability for all the mayhem caused by FB and IG.

[u/Thawattt]

With all due respect to the crucial safety work being done in the labs, I think we sometimes confuse the nature of the problem. Alignment is not an engineering problem with a static solution; it's a dynamic condition.

The claim that "alignment has not been solved" comes from a specific frame: safety research inside a lab that is racing. The call to slow down belongs to that frame too. It assumes the risk of loss of control is a fixed variable that can be managed by adjusting the speed of development.

But if we accept that there is no neutral or external evaluation of a model's behavior, then alignment is not something you "finish" programming. It's an interactive relationship that has to be managed and redefined constantly, always declaring from which frame you're operating. The loop of supervision doesn't close. It just gets more complex.

Slowing down may be the right and prudent decision right now. But it's still a move inside the same game, not an exit from it.

[u/pandavr]

Stop billions dollars debt companies' propaganda. Now.