1
Why LLM decode is memory-bound, not compute-bound
LLM推理核心瓶颈不在算力而在内存带宽,本文透彻解释为什么decode阶段受限于内存而非计算。
Article URL: https://github.com/harshuljain13/llm-inference-at-scale/blob/master/content/00_foundations/00.1_why_llm_inference_is_different/why_llm_in…