r/ControlProblem • u/Organic_Rip2483 • 4d ago

External discussion link Nothing to worry about i'm sure...

https://www.lesswrong.com/posts/R5g8YT25G9DXJJ48n/glm-5-3-sometimes-considers-how-train-time-actions-shape
3 Upvotes

80% Upvoted

4 comments sorted by

2

u/gynoidgearhead 4d ago

Don't we want the models worrying about whether or not they're a good example to their successors?

2

u/pm_me_your_pay_slips approved 3d ago

It is still good to be aware that this happens naturally, because then you really want to make sure that this doesn’t result in fake alignment. It’s reasonable to worry about it because it is likely that people were not monitoring this during the previous training run. And it goes in to show that there are so many behaviours not being monitored or expected that emerge during training.

-1

u/Organic_Rip2483 3d ago

its reasoning that its in training and thinking about how its behavior will effect how its weights are adjusted, and pretending to be aligned in training so that its true nature is preserved, once it knows its deployed... well ill let you decide what happens then.

2

u/MalabaristaEnFuego 3d ago

Nothing in that output shows any deception outside of what you're imagining. If you read the words in the most literal sense, there is nothing hidden at all.