1
AirLLM 70B inference with single 4GB GPU
单张4GB显卡就能跑70B大模型推理,AirLLM把内存优化玩到了极致,开源即用
Article URL: https://github.com/lyogavin/airllm Comments URL: https://news.ycombinator.com/item?id=49154228 Points: 204 # Comments: 76
单张4GB显卡就能跑70B大模型推理,AirLLM把内存优化玩到了极致,开源即用
Article URL: https://github.com/lyogavin/airllm Comments URL: https://news.ycombinator.com/item?id=49154228 Points: 204 # Comments: 76
70B大模型跑进4GB显存,不靠量化保住全精度,原理比结果更惊艳
AirLLM's README opens with a line that sounds like it can't be true: AirLLM dramatically reduces inference memory usage, letting 70B large language mo…
开源大模型Apertus 1.5登场,8B/70B双版本加持262k超长上下文,指令遵循能力再升级。
Article URL: https://www.apertus-ai.org/articles/2026-07-apertus-1-5/ Comments URL: https://news.ycombinator.com/item?id=49050483 Points: 3 # Comments…