o1 doesn’t do tree search, or even beam search, at inference time. it’s distilled.what about o3?we don’t know—those inference costs are very high—but there’s no inherent reason why it must be un-distill-able, since Transformers are Turing-complete (with the CoT itself as tape) https://t.co/hFRZyxverP
cited on: o1
Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.