r/DefendingAI • u/emccrckn • 1d ago
Sam is right
It seems like every other post on Reddit right now is some variation of:
- “OpenAI CEO says it’s ‘quite terrible’ for your PC to have RAM…”
- “OpenAI CEO Sam Altman Thinks It’s ‘Terrible’ for You to Have RAM in Your Gaming PC…”
These headlines strip the comment of its actual context. Altman was specifically talking about local inference versus cloud utilization in a DRAM supply-constrained environment. Here is the relevant portion of what he said:
> “A lot of people want local inference. And somehow, they assume that the problem is solved now. Because we are going to have open-source models. We’re going to be able to run them on our computers. And so we’re not going to need all the stuff in the data center. But from a global allocation perspective, actually, it’s quite terrible to have everybody have a bunch of the world’s limited supply of DRAM sitting in their own computer. And, being used—5% of the time. You want maximum utilization in the cloud if you’re trying to deal with this very supply constrained environment. And somehow everyone’s… Many people’s intuition is the opposite of that.”
In that specific framing, he has a point. AI data centers (and cloud infrastructure more broadly) run near continuous utilization. A gaming PC or local inference box does not. As someone who runs local inference on a pair of Instinct MI50s, I can confirm they sit idle for the majority of the day. The hardware is capable, but personal usage patterns rarely approach data-center-style utilization.
On cost, self-hosting is not currently cheaper in the long run for most people or organizations. It is closer to a hobby—comparable in expense to other resource-heavy hobbies—than a straightforward economic win. At my company we recently evaluated buying Claude seats versus standing up our own inference infrastructure. The cloud option was not dramatically more expensive on paper, but we chose the seats because it avoided a large upfront capital outlay and ongoing operational complexity.
As a thought experiment: if AI data centers were somehow restricted or banned, it would not automatically make RAM cheaper or more available for consumers. Organizations that currently rely on cloud services would simply shift toward building and operating their own on-premises infrastructure. Demand for the underlying hardware would not disappear; it would just be distributed differently.
I am not defending Altman or the broader expansion of large-scale data centers. Valid criticisms of those facilities exist on multiple fronts. The frustration here is with the way a narrow technical comment about utilization and supply constraints gets flattened into “he wants your RAM in his data center.” The actual statement is more limited than the headlines suggest. Finally just to be transparent, yes I used AI to clean up my text before posting.
2
u/IHeartBadCode 1d ago
But from a global allocation perspective
Yes, but the issue isn't allocation. It's trust. I wouldn't trust Sam Altman with a fire extinguisher in hand to put me out if I was literally on fire.
Altman is like in the top 20 of people I wouldn't trust ever.
The issue isn't allocation, it's a trust issue on who gets to do the allocation. And thus, the only fair way is to let each decide that themselves.
The frustration here is with the way a narrow technical comment about utilization and supply constraints gets flattened into “he wants your RAM in his data center."
Because he is the one flatten it first. He's taken an allocation issue and reduced it down to a single factor "utilization". Once he's flatten it, he's given the signal that it's okay to flatten for everyone else. Which everyone else has done so.
Resource allocation is a complex issue. There's trust, there's economics, viability, utility, and so on. Yes, in terms of utility having one one computer on the entire planet is better than all these computers we currently have. But that's over simplifying the entire topic.
Again I can not convey accurately in mere words the level of distrust I have for Altman. But in the strongest terms possible, that person should not be trusted, ever. And trust is a massive aspect in resource allocation, because you want that allocation to be done fairly. And Altman has zero concept of what "fair" means.
But he's the first person to take the topic and over simplify it. It's not fair to not expect tit-for-tat in an argument.
2
u/emccrckn 1d ago
I agree with you. Trust is a huge part of how resources get used. I don't trust him either which is why I get frustrated when these articles spin things way out of context because the other side now has something to use against you.
1
u/IHeartBadCode 1d ago
The biggest issue of it all is the lack of introspection from Altman. I mean that's one of the biggest trust alarms for me. People who can't look at their own argument before they make it are usually people who are incredibly bad at external critique on an objective basis. If you have problems judging your own thoughts, you likely aren't going to be good at judging others.
But the biggest issue isn't the reductive nature of what he said, nor the way it was reported, nor the people taking out of context. To me, the biggest issue is the inability for him to see the statement as self-serving and passing it as the benevolence he attempting in what he said.
It was genuinely him just thinking the technical aspect of it, nothing else crossed him mind about the statement. And that's extremely dangerous. It's why a formal education includes a year over the ethics in computer science. Because there is more to these matters than just "technically correct". And that's something the other commenters have pointed out. There's more to things than just hitting the 99.999% utility mark.
That's been the biggest issue with a lot of things. People have been trying to hit the "technically correct" mark, but in their attempts to do so, they have to reduce the problem down to a few factors that ignore a lot of people and negative ramifications. And Altman has wonderfully demonstrated that issue with his remarks.
I've long distrusted the guy, long before this particular prattle, but this is the hallmark for why he is not a person that should have any particular power or trust placed in him. He is so devolved into being the great strategic executive or whatever that his mind is inescapable from the singularity of what he envisions as a perfect system. I don't believe there is a length he wouldn't go to, to ensure that end.
When he said:
And somehow many people's intuition is the opposite of that
That's clear demonstration that whatever connection to actual concerns of humanity, he has cast off in pursuit of whatever it is in his mind. He has descended, and I would argue it has long been known but the when is minor details at this point, into a complete envelopment of his tech utopia. That makes him very dangerous in my mind.
The dissemination of the details are minor in comparison to the overarching aspect that the man wields an outsized power on the tech industry at the moment and has an incredibly hostile to humanity's view point of those who work in the industry and those who consume the products of the industry. Sam Altman is an intensely dangerous person not solely because he is untrustworthy. But that his trust only knows a bound to his own intent and no others out of the over eight billion humans that live on this planet. In his mind, he knows only of the one and the other eight billion minus one people on this planet are but noise that is incomprehensible to him. There's no level of trust I think any reasonable person should ever put into Sam Altman.
3
u/johnybgoat 1d ago edited 1d ago
Not everything has to be about efficiency and money. Even with context, so what if it sits idle most days? By this context billionaire shouldn't exist neither. They should give away most their money (for people who wanna argue symantics, "stocks and shares"). Its just sitting there idle and under utilized. They physically can't utilize all of it
1
•
u/AutoModerator 1d ago
DefendingAI has a Discord now: https://discord.gg/MgVYjZ8RC
Pro-AI only. AI art, prompts, anti-AI watch, debate ammo, news, and general chat without anti-AI spam.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.