1
Prefill vs. Decode in LLM Inference
洞悉LLM推理中预填充与解码的差异，精准优化首字延迟与流式吞吐。
Article URL: https://www.parasail.io/blog/prefill-vs-decode-llm-inference Comments URL: https://news.ycombinator.com/item?id=49299992 Points: 2 # Comm…
2
non-tech founder + choosing between buying ClaudeCode or CodeX
非技术创始人如何选择AI编码工具ClaudeCode和CodeX，本地测试应用原型，对比两者的核心差异与适用场景。
Hey, so i'm primarily looking to test out app concepts, seeing how the ui design could look at front-end. Play around with features and ux type of mec…
3
PARTREP: Learning What to Repeat for Decoder-only LLMs
解码器架构下重复机制的新探索，学会“该重复什么”或成大模型效率关键
arXiv:2607.01792v1 Announce Type: cross Abstract: While decoder-only LLMs excel at a vast array of natural language tasks, it suffers from an asymmetr…
4
LLM Serving Optimization with Variable Prefill and Decode Lengths
固定KV缓存内存下，智能调度不同长度请求，突破LLM推理效率瓶颈。
arXiv:2508.06133v4 Announce Type: replace-cross Abstract: We study offline scheduling for large language model (LLM) serving under a fixed KV-cache me…
5
Prefill/Decode-Aware Evaluation of LLM Inference on Emerging AI Accelerators
从Prefill/Decode阶段差异出发，为新兴AI加速器量身定制LLM推理性能评估方法，助力硬件选型与优化。
arXiv:2606.17104v1 Announce Type: cross Abstract: As large language models (LLMs) are increasingly deployed in latency- and cost-sensitive settings, i…
6
Making Local LLM Fast
本地LLM提速秘笈：从Prefill到Decode，两分钟看懂推理加速核心环节
Article URL: https://bogdan.nimblex.net/programming/2026/06/10/making-local-llm-fast.html Comments URL: https://news.ycombinator.com/item?id=48489344 …
7
OpenIT
ServiceNow开源替代品，基于ClaudeCode运行，值得关注
OpenSource alternative to ServiceNow that runs on ClaudeCode Discussion | Link