1
OBCache: Optimal Brain KV Cache Pruning for Efficient Long-Context LLM Inference
提出 OBCache 最优脑剪枝方法，精准削减 KV 缓存，让长上下文大模型推理又快又省内存。
arXiv:2510.07651v2 Announce Type: replace-cross Abstract: Large language models (LLMs) with extended context windows enable powerful applications but …