1
A Practical Investigation of Training-free Relaxed Speculative Decoding
无需额外训练即可加速LLM推理的松弛推测解码新策略，实用性能评估与关键发现
arXiv:2607.08690v1 Announce Type: new Abstract: Speculative decoding accelerates sampling from an autoregressive LLM by using a faster auxiliary model…