1
RKSC: Reasoning-Aware KV Cache Sharing and Confident Early Exit for Multi-Step LLM Inference
多步LLM推理新突破:通过推理感知KV缓存共享与自信提前退出机制,大幅提升效率,已被ICML 2026 Workshop收录。
arXiv:2606.09937v1 Announce Type: cross Abstract: We introduce RKSC (Reasoning-Aware KV Cache Sharing), a training-free inference framework that elimi…