For the first ~5k games I used GPT-4o (not mini) and the win stats were:
Flash 1.5 1314
GPT-4o 858
Haiku 693
Good work Google Gemini Flash! Part of this is speed-related (first guess right wins) so it'll be interesting to re-run offline without the time part.
Flash 1.5 1314
GPT-4o 858
Haiku 693
Good work Google Gemini Flash! Part of this is speed-related (first guess right wins) so it'll be interesting to re-run offline without the time part.