ok wait what... so above is probably wrong if @fchollet means "per task (over all 1024 samples)", in which case it's more like 60 tok/s, much more reasonable. but now i'm more confused because...
in reply to: 1870315002172952650
Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.