1
InferScale: GPU-Native KV Injection for Personalized LLM Serving
GPU原生KV注入技术，破解大模型个性化服务中内存检索的性能瓶颈
arXiv:2607.27090v1 Announce Type: cross Abstract: Large language models are increasingly deployed with persistent personalized context, such as accumu…