1
EVA: Accelerating LLM Decoding via an Efficient Vector Quantization Architecture
利用高效向量量化架构大幅加速LLM解码,已获顶级会议ISCA 2026接收,为推理提速带来新思路。
arXiv:2605.24144v1 Announce Type: cross Abstract: Large Language Models (LLMs) have achieved impressive performance across diverse domains but remain …