1
xKV: Cross-Layer KV-Cache Compression via Aligned Singular Vector Extraction
提出跨层KV-Cache压缩新方法xKV，利用对齐奇异向量提取大幅减少显存占用，加速大模型推理。
arXiv:2503.18893v2 Announce Type: replace-cross Abstract: Long-context Large Language Models (LLMs) enable powerful applications but incur high memory…