GPT-4 bombs the Ideological Turing Test, at least for alignment researchers. Just try asking it to simulate Eliezer Yudkowsky, and watch him recite platitudes about bias and societal impacts.This is clearly a regression due to RLHF, as even the 3.5 base model does much better. https://t.co/V3SvbkrXXv