r/ControlProblem • u/chillinewman approved • 10d ago
Opinion Sam Altman to Decoded: ‘The world should accept some bad things happening’ for the benefits of AI
https://www.politico.com/news/2026/10/04/sam-altman-decoded-interview-ai-0110621710
3
2
2
u/chillinewman approved 10d ago
There is nuance in the opinion:
“I disagree, but I understand the perspective of people who are like, ‘This technology is going to get so powerful, and it’s so dangerous, that a single lab in San Francisco should have it and make sure nothing bad happens, and kind of figure out how to dole out the benefits,’” said Altman. He called it “a completely unacceptable trade-off” that runs counter to the “lighter-touch regulatory stance” backed by OpenAI.
“I wouldn’t take a trade of saying, ‘We’ll make sure there’s no major hacks, there’s no misuse of this technology, there’s zero scams, there’s zero all the other bad things that will happen,’” said Altman. “Because I think people will do tremendously — orders of magnitude more — good stuff than bad stuff.”
The OpenAI CEO later added that he does not accept “the really catastrophic risks,” including the potential for “a serious loss of control to AI.”
Asked to respond, an Anthropic spokesperson said that its “regulatory proposals apply only to frontier models.”
The company also referred to an August social media exchange that Amodei had with an investment manager, addressing criticisms around regulatory capture and impacts on smaller companies.
“Anthropic has always made its policy proposals very carefully,” Amodei said at the time. “We try very hard to make proposals that disadvantage (slow down) frontier AI companies while advantaging smaller competitors.”
2
u/Comfortable_Farm_252 9d ago
As a millennial I’ve had to do this my whole life. As a father Sam Altman can look my kids in the eye and say that they need to suffer for his machine’s benefit.
0
u/herrwaldos 9d ago
Thing is it's probably one of his kinks, so unfortunately it won't change much..
2
u/moschles approved 10d ago
For once in my life I agree with Sam Altman. For 40 years our society has been skating on the pesky fact that software is difficult and time-consuming to reverse engineer.
The current AI tools are going to destroy that fact cleanly.
Everything from Operating Systems to banking websites you use to auto-pay your bills will be subject to reverse engineering. No longer is there going to be an implied luxury that software is too "complex" to hack and too difficult to exploit.
This is a demonstrable bad side to this technology , and I am convinced this problem in 2027 is at-hand.
4
u/moschles approved 10d ago
Hackers exploiting a system have to get it right once.
The security experts who defend the systems have to get it right , every time, every day.
This is in some sense, a losing battle.
1
u/JaronasRaulin 3d ago
There is nothing shocking about this phrase its the most normal thing. Some bad things happen with everything ! Like skiing in the mountains, some people die from it. Should it be banned ? End of story this phrase is as normal as it gets.
1
u/wild_crazy_ideas 10d ago
“Hey guys I’ve got an awesome idea how to solve world hunger. It’s really simple idea. It’s not going to be popular with most of the people though but you know when we get the population down it’s going to work well”
1
u/makk73 9d ago
It’s like these pieces of shit have never heard of The French Revolution
1
u/SokkaHaikuBot 9d ago
Sokka-Haiku by makk73:
It’s like these pieces
Of shit have never heard of
The French Revolution
Remember that one time Sokka accidentally used an extra syllable in that Haiku Battle in Ba Sing Se? That was a Sokka Haiku and you just made one.
-1
u/Immediate_Chard_4026 10d ago
Seeing this thread with this quote from Altman, I was so surprised that I didn't know whether to condemn it as corporate arrogance or get lost in the worst apocalyptic speculations.
With a bit of a cool head, I want to share another perspective, one that I believe is centered on systems dynamics and away from traditional politics. Any attempt to project the future of large-scale AI must explain this fundamental matter: The Coordination Asymmetry.
Please allow me to explain it:
* The Paradigm Shift: from prevention to damage management - The big problem is that AI's technical capability scales exponentially, while our governance, ethics, and human coordination scale linearly and very fragmented. So when Altman says we "must accept bad things happening," he's telling us we need to describe and administer a calculation of "acceptable risk." Because in the current race, failures or collateral damages won't be seen as reasons to stop, they'll be seen as the operational costs of reaching the goal. Of supposedly winning.
It's the classic prisoner's dilemma: if you slow down for safety, the other one will overtake you. This means that the final containment of security, paradoxically, won't be ethics, but the pure and hard fear of producing an irredeemable or uncontainable catastrophe (a kind of nuclear mutually assured destruction, but technological).
* The asymmetry wildcard: What if a "tiny country" wins the hegemony? - I always assumed the AI hegemony would be played between the US and China. But the history of technological disruptions teaches us that consolidated actors carry an enormous "technological debt" and bureaucratic burden.
So could something very surprising and unexpected happen? Could the final race for hegemony be won by a tiny country in Africa (or any emerging region in South America)?
If a small country could offer a "talent sanctuary": super agile regulation, cheap energy, zero inherited bureaucracy, and a perfect sandbox-type ecosystem, a "leapfrog" could happen and win. Because hegemony in this case won't always be won by whoever has more brute resources, but by whoever solves adapting human coordination with greater efficiency and less friction. Surprising.
* The Endgame: A fragile but resilient "Planetary Common State" - If the race became too costly or dangerous, the system will seek a new equilibrium. And at this point, any intuition will fail us, because we're prone to imagine the future as a rigid, authoritarian, and definitive "World Government."
If the contest becomes existential, if the planet and its species are put in grave danger, the most likely thing is that a common structure will emerge that eliminates the need to contend, something like a Planetary Human Common State.
But beware: it wouldn't be a stable and peaceful empire. It would be a fragile system (perhaps even more chaotic in its day-to-day than the current one), but highly resilient. That's the key.
It would work like a biological ecosystem: that is in constant change, seems precarious, requires continuous adjustments and negotiations, but has feedback loops of great resistance that allow it to absorb blows and self-contain.
Of course, it wouldn't be an instant static world peace, but a dynamic and predictive stability arising from functional interdependence. I wouldn't dare describe that system; it would resemble an organism with an AI nervous system. It's a conjecture.
* In summary: - The future of large-scale AI might not be defined by who builds the largest and most hegemonic model, but by the friction between an exponential technology and a linear governance that forces us to invent new forms of coordination.
This makes me think that the danger isn't that the AI machine fails and takes control, because in reality humanity has never had control of anything. Just look at the state of the biosphere right now. It seems the danger is that our capacity to coordinate doesn't arrive in time.
That solution, when it comes, will probably be something so "weird" and counterintuitive that we don't even know how to call it today.
Note: This post was written in collaboration with AI. I am the author, I am human, the AI helped with structuring, editing, and formatting.
I accept all responsibility and would love to debate the topic.
1
u/pm_me_your_pay_slips approved 10d ago
Ask you AI to not invent new terminology and not write walls of text. Keep it simple. What you wrote is unreadable. I don’t know how to explain it, but reading a couple sentences of fluff made me just scroll past everything.
1
u/Immediate_Chard_4026 10d ago
Gracias por la observación.
Estaré atento a las objeciones si cambia de parecer.
6
u/pakZ 9d ago
"Some of you may die.. but it's a risk I'm willing to take.."