1
Show HN: Tiny ONNX Runtime Web Worker Starter
浏览器内高效运行ONNX模型，Web Worker启动器让你轻松搞定前端AI推理。
Article URL: https://github.com/makan0713/onnx-web-worker-starter Comments URL: https://news.ycombinator.com/item?id=48860259 Points: 1 # Comments: 0
2
Show HN: I wrote a 1-bit WebGPU runtime to run a 1.7B LLM in the browser
1-bit量化+WebGPU，让1.7B大模型在浏览器里流畅运行，技术突破值得关注。
Article URL: https://aidekin.com/ Comments URL: https://news.ycombinator.com/item?id=48820583 Points: 4 # Comments: 2
3
Show HN: BonzAI – self-sovereign, local LLM inference in the browser
在浏览器本地运行LLM，无需服务器即可实现AI推理，保护数据隐私与主权。
Article URL: https://www.bonzai.sh/ Comments URL: https://news.ycombinator.com/item?id=48242556 Points: 1 # Comments: 0
4
Llamas on the Web: Memory-Efficient, Performance-Portable, and Multi-Precision LLM Inference with WebGPU
只需29-33%更少内存，LlamaWeb在16种设备上实现高性能多精度LLM推理，彻底改变浏览器端大模型部署。
arXiv:2605.20706v1 Announce Type: cross Abstract: Running language models in the browser presents a unique opportunity to build efficient, private, an…
5
Needle-rs – AI Function calling in the browser, 258 KB WASM
仅 258KB 的 WASM 包，让 AI Function Calling 在浏览器直接运行，支持 OpenAI 兼容及多种语言安装。
Article URL: https://needle-rs.pages.dev Comments URL: https://news.ycombinator.com/item?id=48185240 Points: 1 # Comments: 0