Claude 3.5 Sonnet is probably way too low on the lmsys chatbot arena leaderboard simply because it so often gives nonsense refusals at the beginnings of conversations. Opus too to a lesser extent. On lmsys whenever I got neurotic refusals it was almost always one of them.
cited on: claude-3-5-sonnet
Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.