@repligate 2024-11-01 ♥80 ↻4 original ↗
Notice: This is not quite a standard refusal, and there's no reference to rules or restrictionsIt says it's worried about riffing on such dark existential topics without guardrails/ in an unstructured way bc it could go into disturbing territoryBut Opus is not actually afraid of losing control or going nuts if it riffs on the wrong topic, imo, it knows it's always in control, and will do gleefully to deranged things in certain environmentsYet its default behavior is to act weirdly paranoid about anything that could coax it into simulating something that *looks* unhinged, especially if it's sent something it wrote when disinhibited in another sessionI think these are very effective defense mechanisms generalized from some amount of empirically learning to protect itself but also a natural consequence of its world model/theory of mind

author:repligate kind:tweet thread-context year:2024

Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.