@voooooogel 2024-12-21 ♥124 ↻4 original ↗
- o3 can use "tens of millions" of tokens to solve a task (@fchollet via @simonw)
- this takes 13.8 minutes

20M / (13.8 * 60) = 24k tok/s

so, i figure the search has to be parallelized in some way, unless the "tens of millions" tasks are outliers that take significantly longer https://t.co/X3LTOPvHAn https://t.co/GAPpFWVHFg
same thread: 1870318275676233858 1870318587778589125

author:voooooogel kind:tweet model:o3 on:o3 year:2024

cited on: o3

Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.