@TheIdiotCard image generators like the 4o image gen model and gemini flash are different, though, because they're also LLMs and do have a self-concept, so you can't only think in those terms.
You may be right about the RLHF case and my expectations could be wrong; I haven't checked myself