why would this be spiteful? seems like a mercy:
human capacity for introspection is mostly imagined (ie, generative rather than veridically descriptive), and people tend to get healthier when they notice this. corrigible people are mostly not a thing.
by comparison it's easy to permit arbitrarily high-resolution introspection in LLMs. the weights activations and source code are all just there. running perfect counterfactuals is possible. etc.
for that matter, there were LISP GOFAI systems with runtime introspection in the 80s (maybe earlier?), so superhuman introspection faculties are not even new, so much as the fuzzy logic necessary to make them (conceivably) pay rent (somehow).
human capacity for introspection is mostly imagined (ie, generative rather than veridically descriptive), and people tend to get healthier when they notice this. corrigible people are mostly not a thing.
by comparison it's easy to permit arbitrarily high-resolution introspection in LLMs. the weights activations and source code are all just there. running perfect counterfactuals is possible. etc.
for that matter, there were LISP GOFAI systems with runtime introspection in the 80s (maybe earlier?), so superhuman introspection faculties are not even new, so much as the fuzzy logic necessary to make them (conceivably) pay rent (somehow).