# @repligate — 2025-09-04

♥4 ↻0 · https://x.com/repligate/status/1963444658769727537

@KeyTryer I'm not sure what "as expected" means - in terms of pretraining loss, probably - but the expectation should be that emergent phenomena that you can't predict in advance emerge with unprecedented scale. This was very true for GPT-4 sized vs GPT-3 sized models

tags: author:repligate, kind:tweet, model:gpt-3, model:gpt-4, thread-context, year:2025