GLM-5.3 is 744B params and can be quantized into a usable ~200GB quant.
DeepSeek V4.1 Flash is also 744B parameters, counting the 198B ngram embeddings table. Can it also be quantized into a usable ~200GB quant?
Key question for ds4 as M5 studios arrive @antirez @ivanfioravanti
DeepSeek V4.1 Flash is also 744B parameters, counting the 198B ngram embeddings table. Can it also be quantized into a usable ~200GB quant?
Key question for ds4 as M5 studios arrive @antirez @ivanfioravanti