1
Gemma 4 QAT on 10GB Laptop: Local AI with 6.7GB VRAM
用Ollama配合QAT量化,10GB显存笔记本也能跑12B的Gemma 4大模型,内存仅需6.7GB。
This stack uses Ollama with Gemma 4 QAT to run a 12B model on a 10GB VRAM laptop GPU. The latest Gemma 4 QAT checkpoints reduce memory usage and enabl…