用小代理模型精准预测LLM推理性能，省钱省算力的高效新方案。
arXiv:2509.21013v4 Announce Type: replace-cross Abstract: Given the prohibitive cost of pre-training large language models, it is essential to leverag…
揭示LLM服务中内存受限导致的服务诱导拥塞现象，为推理系统优化提供新视角。
arXiv:2606.15555v1 Announce Type: cross Abstract: In large language model (LLM) serving, each request accumulates persistent graphics processing unit …
RTX 6000 Pro跑DiffusionGemma飙出775 tok/s，本地AI推理性能天花板再刷新。
Article URL: https://twitter.com/OrganicGPT/status/2064883777499795716 Comments URL: https://news.ycombinator.com/item?id=48496739 Points: 4 # Comment…