@kromem2dot0 @lennyeusebi they estimated that they have terabytes of K/V memory (based on the assumption of being a trillion parameter dense model), not sure how accurate that is, but... https://t.co/3yo4sVCX2D
same thread: 1963641664825954489 1963642900346265913 1963662795557490870 1963677757373903022 1964392461553508480 1964396218278433217 1964398151286345815 1964398735980712027 1964408837164978354 1964409806187610390 1964416115062559140 1964418930908549137 1964420414639394954 1964421688814342327 1964421778975183036 1964424976146317344 1964426675523080576
Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.