@disconcision @IvanVendrov indeed, message/node boundaries are a perennially annoying issue
being able to branch after any token is actually very useful for chat models too (ones that support prefill) and very underexplored
being able to branch after any token is actually very useful for chat models too (ones that support prefill) and very underexplored