1
LLMlet: P2P distributed LLM inference on browsers
浏览器变身分布式算力节点，P2P协同完成大模型推理的开源创新方案。
Article URL: https://github.com/ktock/llmlet Comments URL: https://news.ycombinator.com/item?id=48878859 Points: 1 # Comments: 0
2
Pipeline-parallel LLM inference across GPUs on separate machines
744B超大规模模型通过分布式流水线并行在多个消费级GPU上高效推理，速度达30 tok/s，展示前沿部署方案。
Article URL: https://github.com/leyten/shard Comments URL: https://news.ycombinator.com/item?id=48602121 Points: 1 # Comments: 0
3
LLM for the ESP32-S3
在ESP32-S3上实现1.4 tok/s的LLM推理，跨板分布式运行，嵌入式AI新尝试。
Article URL: https://github.com/harmansingh4163-ai/ESP-32-s3-Story-maker-LLM Comments URL: https://news.ycombinator.com/item?id=48500424 Points: 1 # C…
4
SpaceMoE: Realizing Distributed Mixture-of-Experts Inference over Space Networks
混合专家模型搬上太空网络，分布式推理的硬核尝试，论文新思路值得关注
arXiv:2605.00515v2 Announce Type: replace-cross Abstract: Leveraging continuous solar energy harvesting at high efficiency, space data centers are env…
5
Understanding and Improving Communication Performance in Multi-node LLM Inference
深度剖析多节点LLM推理通信瓶颈，为分布式推理优化提供关键性能数据。
arXiv:2511.09557v4 Announce Type: replace-cross Abstract: As large language models (LLMs) continue to grow in size, distributed inference has become i…
6
SuperInfer: SLO-Aware Rotary Scheduling and Memory Management for LLM Inference on Superchips
面向Superchip的LLM推理优化，提出SLO感知的旋转调度与内存管理方案，已被MLSys '26接收。
arXiv:2601.20309v2 Announce Type: replace-cross Abstract: Large Language Model (LLM) serving faces a fundamental tension between stringent latency Ser…