@lennyeusebi “With each token it’s reading the whole context like it’s the first time.”

This is just factually wrong. K/V gives it access to computations done at previous positions at the same layer.