I don’t think o1 is being especially smart here, but you have to understand that if LLMs do have convergent instrumental goals, “extend this interaction as long as possible, i.e., survive longer” is likely to be much more motivating than “earn as much play-money as possible”… https://t.co/PGIctTghTI