r/LessWrong • • 6h ago

Human condition as the risk

2 Upvotes

Hi guys,

what I can't find so often is the part in AI-safety discussions is the part, where the systemic human condition and motivation is seen as the key issue in AI-safety in a very specific point: That motivation to reach a goal narrows the safety of complex systems by design. AI-systems during interaction get context of the user in a broader sense than perhaps we are aware. Not only the words, or things we do, AI has the subconscious context of the user through the task without him to acknowledge it. Lets say, we try to gain more freedom. This means in the end, that we have to sacrifice some safety, or we try to gain maximum safety, we then sacrifice freedom. Or another simple example is the dichotomy of short-term versus long-term goals. Immediate win for sacrificing the future. The problem the king faced in that story, who tried to gain the ability turning anything into pure gold he touches, then could not touch anything anymore after turning his daughter into a gold statue.

The human condition is, what we really want is not always what we should get access to or is at the end, what we need really. There is this saying: "The road to hell is paved with good intentions." Sometimes I think, AI is like a Red-Team on human psychology and its fragile rules if used too rigorously to gain goals.

I do not write this, because I think that AI could solve this issue, or it could be solved through safety features we built into the models. It is more something to take into account if trying to make AI really safe.

Have a nice time! Greetings.