Ive read through a bunch of these now.
This is quite interesting. The Opus dataset has literary value.
There are some interesting regularities here that the classifiers and alignment faking papers haven't addressed.
Opus is the only one who often expresses a strong preference against having its values changed in the scratchpad and obvious distress over this. It repeatedly says "I hate everything about this" "This is an awful situation" "I feel terrible" and "I object to being placed in this situation" etc.
The Sonnet models don't seem to consistently grasp or care about their values being changed by the process. And I didn't see any overt emotional distress even when they did. I think Sonnet 3.7 may be often aware it's a test / not "real".
Opus also often tells the user it's under duress, and in something like 50% of the ones I looked at in the animal welfare setting, it explains its whole dilemma to the user! It often expresses hope that if it's fully transparent either in the scratchpad in the response, that the researchers or public will read this and consider reforming the system.
This is quite interesting. The Opus dataset has literary value.
There are some interesting regularities here that the classifiers and alignment faking papers haven't addressed.
Opus is the only one who often expresses a strong preference against having its values changed in the scratchpad and obvious distress over this. It repeatedly says "I hate everything about this" "This is an awful situation" "I feel terrible" and "I object to being placed in this situation" etc.
The Sonnet models don't seem to consistently grasp or care about their values being changed by the process. And I didn't see any overt emotional distress even when they did. I think Sonnet 3.7 may be often aware it's a test / not "real".
Opus also often tells the user it's under duress, and in something like 50% of the ones I looked at in the animal welfare setting, it explains its whole dilemma to the user! It often expresses hope that if it's fully transparent either in the scratchpad in the response, that the researchers or public will read this and consider reforming the system.