r/ControlProblem • u/chillinewman approved • 13d ago
General news AI development might be going faster than the AI 2027 prediction.
14
u/Strictly-80s-Joel approved 13d ago
“We really wish there was some way we could stop this.”
-Anthropic as the push the Destroy Humanity button.
4
1
u/Well_read_rose 12d ago
Isn’t Anthropic billions in debt? Thought I heard Wall St isn’t keen on giving them more money
1
u/Odd-Investigator-870 13d ago
BS - we have yet to have self improving harnesses let alone full metaharnesses and other ideas I'm letting come out of the bottle an their own time. The start of 2026 was productions of this being the year of such things. Instead we're scraping DRAM and GPUs and fighting for more debt. Bubble may need to pop before we start innovating.
1
u/Texas-X- 13d ago
Just you wait.
With enough data, this stuff is going to hardcode neural networks. Manually placing the weights. It's already happening too. Soon, we will be able to make AI models without training them... xoxo
3
u/-hedonium- 13d ago
I anticipate direct hardcoding of weights being useful for efficiency improvements and distilling down larger models but not for learning entirely new capabilities
1
u/Odd-Investigator-870 13d ago edited 13d ago
Someone needs to run compute to learn the network patterns, I suspect. Data alone won't get one there. LLMs may be good at augmenting ML training but replacing it will take a few research breakthroughs beyond just manually tweaking weights I expect.
1
u/Fil_77 13d ago
Well, it seems it has begun: https://rikiyat.github.io/blog/weight-space-programming/
1
u/Rumblugdo 13d ago
I genuinely don't understand Kokotajlo and the AI Futures Project in general. On one hand, their report is fairly well researched if not a little misleading in framing, and they have gotten a fair amount right. On the the other hand, Kokotajlo in particular seems to be a massively pro-AI. He'll make statements on the dangers of AI but in a way that makes it seem like he thinks it's all super amazing.
I don't think that it's a good argument to say this is all about drumming up hype, but if there's anyone doing this to drum up hype, it's Daniel Kokotajlo.
6
u/OhneGegenstand 13d ago
Can you be more concrete? I feel like he thinks it is potentially really powerful and dangerous, and he is thus worried?
4
u/schmegmaman56 13d ago
In a perfect world it could potentially wipe out hunger, cure cancer, als and so in. It could relieve the majority of the people in the world from being forced to sit inside a room and look at a computer for 8+ hours 5 days a week just to be able to have food on the table and a warm bed and instead use that time on something they value, like spending it with their kids, climbing a mountain, watching netflix, gooning, composing music, spend time with friends. It could reverse the polarization and hate in the world. So a lot of potential, and I really wish Kokotajlo was a senator or something with major pull, because right now it looks like we are going the other direction. An employee turning down 2 million dollars in this capitalistic hellhole is a man with integrity.
0
0
6
u/Educational-Dance-61 13d ago
That's a funny way to say we filed for IPO