1
River-LLM: Large Language Model Seamless Exit Based on KV Share
基于KV共享的LLM无缝退出机制，大幅降低推理延迟，兼顾性能与效率。
arXiv:2604.18396v3 Announce Type: replace Abstract: Large Language Models (LLMs) have demonstrated exceptional performance across diverse domains but …