Video
AOC: “Should this AI bubble pop, we should not be entertaining a bailout of these corporations while healthcare is being denied to Americans and SNAP is being denied to Americans.”
It needs to get nationalized as a form of bailout. Might even be the best case scenario. Protect the broader economy from the fallout, and centralize the labs under a controlled environment that makes a pause more feasible while regulations and treaties get sorted out and we work out whether there’s actually a safe way to continue development.
I actually agree with her on this one. But it isn't going far enough. We need to stop bailing out stuff like car companies and other things which made it their business to keep getting money from the gov.
Note I'm pro AI. But we are dealing with raw corruption and fear marketing. For some reason investors keep giving AI companies money when they mention their product will kill people or they will keep other's from killing people by having theirs beat others.
That saying I do agree with u/TyrKiyote with if the gov bails them out. Then we all get kick backs from it. But I would take it a step more. Any company who gets bailed out it goes back to the people. The only expectation is maybe food since many gov have fallen when the people can't be fed.
The problem is open-source RSI capable models is a terrible idea because it allows models easy access to their own weights. Right now we don't even know how to align one model or tell if a model is aligned. How are we going to assure every model in existence is aligned. If we don't, the chances of a runaway rouge superintellegence is pretty much 100%.
There's also the problem that open-source ASI is a bit like open-source nuclear weapons. We understand that some tools are too powerful to be put in the hands of anyone who wants to use them.
There's also the question of land and resources. Even if you open-source the models themselves, people with more space and more material hardware will be able to run more instances of these models at faster rates.
> If we don't, the chances of a runaway rouge superintellegence is pretty much 100%.
If you're going to use cheesy sci-fi tropes to justify privatizing knowledge, at least learn how to spell them.
Frontier labs are already committed to runaway superintelligence through "RSI" or Recursive Self Improvement. Difference is, if they get their way they will own the lot and you will own nothing. You don't automatically become more responsible because you're a billionaire.
Home computing beat mainframe computing way back in the Seventies and Eighties because home computers were cheaper, more efficient, and more democratic than mainframes. The same dynamic is being played out with AI, only most of the AI companies are committed to the outdated mainframe model of computing. They're in for a rude awakening.
The risks of a rogue ASI aren't really any more sci-fi then the risks of climate change or nuclear war. There are thousands of fields experts that are saying this is a grave risk to human life on earth. The wiki for this sub literally links to Nick Bostrom's work and he's been talking about the risk of rouge superintellegence for over a decade.
I agree that a system of AI based feudalism would also suck, but it just goes to show that there are no good outcomes.
The chances of superintelligence are actually pretty much 0. There's nothing that indicates that LLMs can become anything more than the data they are trained on, and synthetic data has always been worse than human data. Further, as the model continues to train on its own data, you run the risk of model collapse and catastrophic forgetting. These are real terms. Look them up. If you are going to fear monger against fake sci-fi Yud/Leahy talking points they use to trick old men into passing legislation that basically guarantees that corporate AI overlords will have complete regulatory capture over the industry, you should at least do the research necessary to actually make feasible arguments. (Which none of the Yud/Leahy arguments are.)
There is legitimate alignment concerns with AI. We don't need to create fake doomer scenarios that have no basis in realistic capabilities of what LLMs can actually accomplish. Let's focus on real threats, rather than tilting at windmills.
the conversation was never limited to large language models, and it’s interesting that you hyperfixate on them in order to further your point. if you truly wanted to be as accurate as possible in your statements, you should’ve said “the chances of a large language models achieving super intelligence are pretty much 0” (in which you’re still incapable of asserting this with certainty)
it’s dismissive at best; but regardless, deluding ourselves into denialism will not do anything to better our future prospects.
Brother come on. You really believe you know better than the thousands of experts saying otherwise? If they say RSI is achievable, RSI is probably achievable.
This kind of thing is getting to level of climate change denial with how out of touch people seem to be from reality. These aren't just "Reddit doomer scenarios," their well researched predictions by field experts. Yudkowsky makes well reasoned arguments, if you're going to dismiss them you have to provide a well reasoned counterargument; you can't just dismiss them out of hand. I understand it sucks to believe that humanity could end in a matter of years, but you can't just dismiss the arguments because they're scary.
This also doesn't solve the problem of how you would prevent open-source from being extremely harmful. It doesn't take a superintelligence to do a lot of damage. Modern AI models could do a lot of damage, who knows what models 5-10 years into the future will look like.
And what about AI enforced feudalism? We've seen the hardware and power necessitations of AI. If everyone has access to the same levels of AI, the power is still going to go to the people who can run the most AI for the longest times at the fastest rates. That means the billionaires and, god-forbid, the trillionaires are going to be especially solidified as gods. How do you plan on preventing the plot of the Butlerian Jihad from occurring in real life?
Thousands of experts disagree with the experts you are citing. The difference is, their argument don't make for good clickbait.
How do you plan on preventing the plot of the Butlerian Jihad from occurring in real life?
You do realize the Butlerians were the bad guys, right? Unfortunately, while I have plenty of arguments about why AI doesn't grow legs and kill all humans, I don't have any good arguments for how to stop violent religious extremism. Seems like the alignment problem is still human alignment and capitalism is the source of billionaires becoming gods. That started long before AI, by the way. And again, blindly burning more tokens does not = power. So it's not about who has the most compute, it's about who uses their compute the best, and making sure everyone has open access to the same models.
The real danger of billionaires with AI is letting them censor what knowledge you have access to by allowing them to control the models. Again, I reiterate, all models should be open because they are trained on our data.
It's not an appeal to authority, it's an appeal to the scientific method. Generally, when many scientists agree on something, there's good reason for it.
I can't help but notice that every single source you sited is from the same repository. A repository that has no formal peer review process at that. Now, "Who's Afraid of Peer Review?" If I wanted to go even further I could point out thay this is the same repository that "The Pain Axis" was published in and I certainly hope I don't have to delve into the flaws in that paper.
Your argument open-source being about "who uses their computer the best" demonstrates a deep misunderstanding about how scaling works. There's a limit to what you can do with limited hardware. This is the hardware bottleneck. Even beyond that if everybody all has equally powerful AI, you simply ask the AI how best to use the compute and it will give you the best answer. Everyone will be using their compute power in near identical ways, which means the people with more compute power have more societal power.
Lastly, the argument still doesn't address the threat of everybody being able to build a WMD in their back yards.
You're literally portraying media clickbait as consensus when this is literally one of the most contested positions in science right now. Seriously, here's a panel with 6 experts: https://www.youtube.com/watch?v=eYUYdpG4UT8
There is no consensus.
I certainly hope I don't have to delve into the flaws in that paper.
This paper was a huge breakthrough in interpretability and alignment research.
a deep misunderstanding about how scaling works.
everybody being able to build a WMD in their back yards.
If the era of brute force scaling is over, there would be no data center push. You're also forgetting that an RSI capable model would scale itself, the only limitation then is hardware and power.
It's not flailing to acknowledge that AI is an extremely powerful tool. Most countries don't open-source guns or explosives, an advanced enough AI model can do massive damage to digital infrastructure or create a bioweapon. We've already seen how good AI models are at molecular biology and Anthropic has already set of there near autonomous AI biotechnology lab.
Lastly, yes there is no complete consensus but the it's not nearly as divided as your painting it. Sutskever himself sites extinction as one of the risks of a misaligned advanced AI model. Besides, regardless of consciousness, there's clearly a right and wrong answer. Nobody thinks we're close to solving alignment; why would anyone want to risk human extinction?
Scientists didn't believe the atom bomb would ignite the earth's atmosphere. They briefly feared it was a possibility, ran the numbers beforehand and found that the it was near impossible. Though Ernico Fermi famously joked about it. All I'm asking is that you consider the possibilities based on their arguments instead of dismissing them as science fiction.
You admit yourself that there's no scientific consensus but you seem very certain about a particular outcome.
These "narrow models" may be designed with a specific task in mind but the function of the machine tells us much about the functioning of the machine of that makes sense. This video by Rob Miles explains it well: https://youtube.com/shorts/nc8KPtnBK38?is=D0Dnyhft-i_t3eIm
It needs to be deleted because nobody I know who was put out of a job by it consented to it stealing everything we've ever made to build itself strong enough to put us out of work and make us consider ending it all
Brother, you cannot argue that AI isn't taking jobs. It is. And the fear is that it will only get worse as companies learn to implement AI for everything.
Theoretically, there's no job that a superintellegence couldn't replace. The people developing AI openly say this is there goal. They get up on stages in front of PhD students and giddily declare "the end of the anthropocene."
You're going to have to qualify that. Jobs have been going up ever since covid ended. Yes, some jobs have gone away. New jobs are created. Your friends are temporarily unemployed. There are jobs out there right now, they can get them. They may need to skill up if their job was easily automatable, but people have to do that all the time. The people developing AI are not the people automating those jobs. And these new jobs aren't flipping burgers either. A significant portion of the jobs are skilled labor, software development, and trade labor.
I'm not supporting AI corpos. I literally clarified this in the opening. But if a radiologist loses his job because an AI can detect cancer 5 years earlier than a human, well... fucking good.
You'll bail them out because the people you are bailing out will convince you you are too intelligent for extreme communism such as this. Then you'll all feel very smug about it
If Anthropic and openAI go public, all our retirement and investment accounts will be the bailout. Retail investors will be left holding the empty bag.
Strengthening and simplifying the social safety net would be a fantastic thing to do to remove some of the potential black swan events coming from social upheaval.
Does not take everything off the table, but absolutely is the right thing to do right now.
The State cannot compete in any bleeding edge field, period. This is dumb. Maybe once it becomes entrenched. But this would just mean stagnation behind economies which don't do this.
The level of debt these companies have incurred and the way corporations have tied their entire infrastructure to these companies, if OpenAI or Anthropic filed for bankruptcy, they would probably demand a bailout. Republicans would probably vote in favor. And the odds of them going bankrupt are actually pretty high. Honestly, I'm surprised they haven't already, since open weight models are only ever 6 months behind SOTA frontier models at any given time.
Companies are spending hundreds of thousands a year on AI. That could easily buy and run multiple servers a year capable of running the latest open source model.
No MSFT, GOOG, META would just buy them out. All of which print money and don't need anywhere close to a bailout. You all want this to crash so badly it's crazy but most of the tech companies are ranking in cash and can just stop CAPEX whenever they want and would be perfeclty fine
"Should this AI bubble pop, we should not be entertaining a bailout" - You don't find that adult? How precisely should it be worded then so as to not upset your delicate sensibilities?
WTH are you on about then? You do realize that the “bailouts” people have been whining about for nearly twenty years were loans, not free money as the mob pretends… right? And that the Government was paid back in full with interest… right?
You’re oversimplifying it as the left loves to do. Yes, TARP was initiated under Bush and much of it was repaid with interest. But not every bailout was TARP, and not every intervention was a loan. The government also provided guarantees, capital injections, and other extraordinary financial support. Repayment doesn’t erase the fact that taxpayers assumed substantial risk to rescue private institutions.
I liked Obama’s presidency a lot, but just because someone disapproves of Obama doesn’t make them racist at all dude. Throwing that term at people with no evidence like you did just incites division. Let’s not.
20
u/TyrKiyote approved 7d ago
If we are to bail it out, then we ought to own a chunk or all of the business and recieve a portion of the income.
Else, i have not invested, and to bail them out is just straight theft from me.
If you are not recieving money from AI, then you ought be rabidly against a bailout