What's really interesting about GPT-4 base supposedly being full of demons is that LLaMa 3 405B isn't like that. I wonder how much of that is active intervention from Meta on data mix/etc and how much is just that the corpus has changed greatly since GPT-4 base was trained. https://t.co/ApWmypvqCv
cited on: gpt-4-base · llama-3-1-405b-base
Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.