IBM Watson is back (alias Dromedary) and it beats GPT-4 at TruthfulQA-MC. It’s a variant of Constitutional AI, with LLaMa-65B as a base model and *no RLHF* or distillation from RLHF’d models. This seems good to me and may avoid the stubborn perverse-instantiation problems with RLHF.
https://t.co/rNlnc8tffv