直接在内存中计算LLM推理，打破传统内存墙瓶颈，为边缘设备部署大模型提供新思路。
The excitement surrounding PrismML’s 1-bit/ternary Bonsai models has the industry closely watching how smartphone giants, particularly Apple, will imp…
打破DDR4时序规则在DRAM中运行PrismML的Bonsai模型，颠覆边缘设备AI部署的成本与隐私逻辑
The excitement surrounding PrismML’s 1-bit/ternary Bonsai models has the industry closely watching how smartphone giants, particularly Apple, will imp…
浏览器运行1-bit量级大模型，WebGPU加速，前沿高效新体验。
Article URL: https://huggingface.co/spaces/webml-community/bonsai-webgpu Comments URL: https://news.ycombinator.com/item?id=48936994 Points: 3 # Comme…
1-bit量化+WebGPU，让1.7B大模型在浏览器里流畅运行，技术突破值得关注。
Article URL: https://aidekin.com/ Comments URL: https://news.ycombinator.com/item?id=48820583 Points: 4 # Comments: 2
突破性KV缓存量化方案，实现sub-1-bit压缩，大幅降低推理内存开销却不损精度。
arXiv:2607.01065v1 Announce Type: new Abstract: The deployment of Large Language Models (LLMs) with extended context windows is increasingly constrain…
突破性LLM压缩至低于1比特，结合草图算法与硬件友好算子，实现极致模型瘦身。
arXiv:2506.17255v2 Announce Type: replace-cross Abstract: Large language models (LLMs) require larger GPU memory size these days, necessitating effici…
颠覆传统，用预训练大模型突破1-bit量化瓶颈，既省存储又保精度。
arXiv:2508.06974v2 Announce Type: replace Abstract: 1-bit LLM quantization offers significant advantages in reducing storage and computational costs. …
1-bit量化大模型新思路，输出对齐策略再审视，助力低资源设备高效推理
arXiv:2512.21651v3 Announce Type: replace Abstract: Large Language Models (LLMs) deliver strong performance across a wide range of NLP tasks, but thei…