1
HiSpec: Hierarchical Speculative Decoding for LLMs
针对大模型推理中投机解码的验证瓶颈，提出层次化投机解码方法，显著提升推理速度。
arXiv:2510.01336v2 Announce Type: replace-cross Abstract: Speculative decoding accelerates LLM inference by using a smaller draft model to speculate t…