"introspection is mostly generative" (which imo is true and helpful for both humans and LLMs) is a different claim than "introspection is not entangled with anything veridical" or "introspection is useless" (which I think are false and harmful for both humans and LLMs)
I think that when humans and LLMs deliberately introspect, you'll be able to find meaningful increases in mutual information if you know where to look
As for superhuman introspection, I agree that it's possible in principle for LLMs, but I think it mostly has not been implemented yet
I think that when humans and LLMs deliberately introspect, you'll be able to find meaningful increases in mutual information if you know where to look
As for superhuman introspection, I agree that it's possible in principle for LLMs, but I think it mostly has not been implemented yet