@ivanfioravanti have you done any experiments to push the quantization smaller? especially on the ngram embeddings?

it'd be cool to fit it into a 256GB setup. maybe weights ~200-210GB, like GLM-5.3?

not sure if its feasible with the embeddings table. but it'd be cool to see.