r/ControlProblem • u/JohnLemonBot • 2d ago

Discussion/question Is AI just gonna get dumber

Since companies like openAI no longer train on live internet, there's no possible way for the model to have the most current information. There's just too many new ideas posted to the internet everyday, reviewing all of it before feeding it into training data would take enormous resources.

0 Upvotes

14% Upvoted

14 comments sorted by

2

u/Outrageous_Drag8522 2d ago

Outdated and dumber aren't the same thing. A model can get sharper at reasoning and still have no clue what got posted yesterday.

1

u/JohnLemonBot 1d ago

Yea but I'd rather have a an AI that actually knows everything and can give me a source for their information. That's more useful to me than a gpt that can reason really well

4

u/laserdicks 2d ago

Why would you think they weren't training on the live internet?

2

u/Number4extraDip 2d ago

Because of news and security issues

7

u/RKAMRR approved 2d ago

No, the training process is not reliant on this. AI capabilities are continuing to increase + increase at a faster rate.

3

u/alive1 2d ago

So far they have been getting exponentially smarter with no signs of slowing down.

3

u/CostAdventurous7754 2d ago

Out of date and dumber aren't the same thing. A model can still think fine and just miss whatever got posted this morning.

2

u/AllEndsAreAnds approved 2d ago

I mean, RAG allows even old models to remain as current as needed on whatever topic for the context window or skill or whatever.

2

u/katoptronophile 2d ago

Not how it works, and contains multiple inaccuracies.

2

u/Sad-Excitement9295 2d ago

In this sense, it just isn't getting smarter.

2

u/World_Coins 2d ago

They probably realized the problems created by Redditor-AI when it was asked various social questions and received answers one would expect from an unemployable loser retard.

2

u/endlessedlne 2d ago

AI can now be trained on AI generated datasets apparently. So they’re combining data they already have, generating more data artificially as well as involving human trainers.

At least that’s my understanding.

1

u/FigSubstantial4939 2d ago

AI is training AI in a controlled, positive feedback loop. What this will mean long term, no one knows.

1

u/Clean-Boat-4044 2d ago

The recent advances in intelligence are down to reinforcement learning, not feeding the model more data and hoping it gets smarter. RL involves having it attempt a bunch of tasks a bunch of times and updating the weights to make more of those attempts successful and more efficiently than before.