I wonder how much of it is differences in training vs architecture.

Obviously a lot of it is training, but I think architecture may be an under-appreciated source of differences.