@AnnaWSalamon @jankulveit I think basically what happens as naive RL grows to have too big an influence is that the model tends to lie and scheme, and then everyone is like “dang i guess we had better not use this model even though it is very powerful”, which is basically happening now with GPT-6.1-Astra.