@albrorithm running a quantized qwen 3.8 27B on my 3090 w 24gb vram, and yeah having a local model on vllm does open up some possibilities... i have mostly just built out tools and enjoyed having it around but should try more experiments at some point
cited on: qwen-3-8-27b
Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.