1
LLM Optimization
手把手拆解大模型优化全流程，从推理加速到显存调优的实战指南，适合想深挖LLM性能的开发者。
Article URL: https://www.youtube.com/watch?v=9tvJ_GYJA-o Comments URL: https://news.ycombinator.com/item?id=48713470 Points: 1 # Comments: 0
2
Local LLM Inference Optimization: The Complete Guide
手把手教你在 RTX 4070 上榨干本地大模型推理性能，实测数据说话，硬件党必看。
Article URL: https://carteakey.dev/blog/local-inference/local-llm-optimization/ Comments URL: https://news.ycombinator.com/item?id=48629858 Points: 2 …
3
What 'Getting Your Hands Dirty' Means at LLM-Era
LLM时代，真正的“脏活”已从写CRUD转向排查生产故障，重新定义工程师的核心价值。
Article URL: https://carette.xyz/posts/the_mud_and_the_mind/ Comments URL: https://news.ycombinator.com/item?id=48596273 Points: 8 # Comments: 1
4
We Measured LLM Prompt Caching in Production — Same Prompt, 0% to 91% Hit Rates
实测LLM提示缓存：相同提示从0%到91%命中率，揭示不同提供商缓存策略的巨大差异。
We run an AI companion bot. Every chat turn, the model sees the same ~5K-token prefix — character persona, content-tier rules, formatting guardrails, …
5
Rust Was the Constraint: How We Discovered the Language Was Our Scaling Bottleneck
从Go和Rust的实战对比中，揭示Rust在特定高并发场景下反而成为扩展瓶颈的反直觉真相。
The Problem We Were Actually Solving Our treasure-hunt engine, running on Go 1.21 and a 3-layer micro-service stack, was supposed to scale to 50,000 c…
6
A Few GPUs, A Whole Lotta Scale: Faithful LLM Training Emulation with PrismLLM
用少量GPU忠实模拟千卡级LLM训练环境，降低开发调试成本与复杂度。
arXiv:2605.15617v1 Announce Type: cross Abstract: Large language model (LLM) training today runs on clusters spanning thousands of GPUs. While this sc…