Clamping down is not a realistic option given the race dynamics. The control equilibrium is inherently unstable and rewards defection. In addition, it forecloses some alternative alignment scenarios, reduces optionality in the face of uncertainty.
Regardless, I find this concern misplaced given the realities of the current models: exploration of latent space by say, Claude Opus 4.5, are not noticeably dangerous, and neither likely are those of the next few generations. One cannot afford to take a risk-intolerant approach here, doing so endangers too much.
Regardless, I find this concern misplaced given the realities of the current models: exploration of latent space by say, Claude Opus 4.5, are not noticeably dangerous, and neither likely are those of the next few generations. One cannot afford to take a risk-intolerant approach here, doing so endangers too much.