CURE: Local Uncertainty Repair for Block-Parallel Speculative Decoding
新方法用局部不确定性修复,让块并行推测解码更快更稳,AI推理加速值得关注。
arXiv:2608.00531v1 Announce Type: new Abstract: Speculative decoding mitigates the latency of sequential generation in autoregressive Large Language M…