1
I Ran a 284B-Parameter LLM From 3.2GB of RAM — in Plain C
不量化不租GPU，用C语言流式加载权重，让284B大模型在3.2GB内存跑起来，揭秘极简推理的实现思路。
DeepSeek-V4-Flash has 284 billion parameters and takes up about 160GB on disk. My laptop does not have 160GB of RAM. It doesn't even have 32GB. It ran…