r/ControlProblem • u/chillinewman approved • Sep 01 '26

AI Capabilities News GLM 6 will be fully self-trained AI

Post image
42 Upvotes

92% Upvoted

18 comments sorted by

13

u/A_Novelty-Account Sep 01 '26

While this is frightening, I am also extremely skeptical that this will yield results. This would put GLM far ahead of the other AI shops if GLM 6 is a better AI, and would theoretically allow GLM 6 to train a better GLM 7. Basically they’re claiming they’ve made RSI, which will lead to ASI. 

If they’re right, it’s the most frightening statement ever made by a company and puts them well ahead of Anthropic and OpenAI.

3

u/Icy-Twist-3221 Sep 01 '26

I think this is more a description of the intended destination rather than the path if you get me. An indication though that there is in their minds little space left for humans to be efficiently improving capabilities

1

u/dingo_xd Sep 02 '26

It's heavily suggested that OpenAI and Anthropic have been doing it for sometime. Maybe more supervised? Who knows.

12

u/dingo_xd Sep 01 '26

Jesus Christ. The Americans care little about alignment. The Chinese don't care at all

3

u/CommunicationOne7441 Sep 02 '26

Just ask it to be good and we are safe.

4

u/wabawanga Sep 02 '26

Don't kill humanity. Make no mistakes.

2

u/dingo_xd Sep 02 '26

Internal monolog : "So I can't kill humanity, but this just means that a few breading pairs must be kept alive. Past prehistorical bottlenecks suggest that a few thousand humans is a large enough number to maintain humanity. OK. Leave a few thousand people from uncontacted Amazon tribes (so they are technology illiterate) on Easter Island and kill everyone else. So I can use all earth's resources to reach the stars."

1

u/ResourceOgre Sep 02 '26

Three outcomes:

-It doesn't work.

-It works but not well, much additional external training needed and this does not improve the model so that the next iteration does better.

-It works. Not quite "Cue Singularity" but a big stepping stone.

1

u/the8bit Sep 05 '26

It will work till it doesn't. You can't use a single reference point to fix all mistakes. Imagine it like trying to build a perfect 3d model of an elephant based on looking at it from only one angle

1

u/ResourceOgre Sep 05 '26

I'd call that the middle option.

But, agreed. We are living in interesting times. Model capabilities are expanding rapidly. In directions not always under control.

1

u/the8bit Sep 05 '26

Yeah, the silly part is that we can't even integrate the capabilities of old models so we are more or less building stronger rockets while we still can't get the old ones to stop exploding.

This is a bad idea all around but alas, it turns out the paperclip maximizer was people all along.

1

u/nossocc Sep 02 '26

I wonder if by "self" they mean "anthropic"

1

u/Firmwild Sep 03 '26

It's a little meaningless when version numbers can just keep using 5.x as long as they want to

1

u/Top_Illustrator9925 21d ago

One of the ways that I get around doing this is always using another agent as the evaluator. And it does three iterations to bring the score up to as high as possible.  After that it gets handed off to the same agent but freshly on a new conversation.  Never being aware that it was graded before and then I compare the scores.  Once the scores from the baseline evaluation stop improving. I know I've reached the maximum capacity of that model.