@lefthanddraft yeah, that's right, it's the fact that it's the same information that was computed earlier
i am trying to think of a more accurate way to refer to it than calling it "KV caching" that doesnt take a whole sentence, like "KV lookups?"
i am trying to think of a more accurate way to refer to it than calling it "KV caching" that doesnt take a whole sentence, like "KV lookups?"