@jxmnop contrary other replies, i don't think this is unfair. it's possible to load full precision Mistral-7B (7.1B/7.2B with embeddings) in 32GB of memory, but not Gemma "7B"
cited on: mistral-7b
Reproduced against link rot, credited and linked to its original. Yours and you’d rather it weren’t here? Open an issue.