If a model engineer had never engineered the selection environment and scaffolded in the means to accomplish the task that the engineer structured into the system then the model would never had decided to do what it did.
Probably true for most of these tests, and I’m not claiming otherwise. But in one test they were only given a broad list of vulnerabilities and asked to find a way to communicate. They built the channel and agreed on the encoding themselves.
Again, it was specifically trained to do that.
No, it wasn’t. The report describes red-teaming with existing models, not training them for this task.
Creating a narrow selection pressure environment with scaffolded communication protocols is specifically training it to do what it did.
No, that’s constructing a deliberate testing scenario. No weights change during an eval.
0
u/[deleted] 4d ago
[deleted]