1
IntentKV: Cross-Turn Intent-Aware KV Cache Pruning for Agent Inference
针对Agent推理场景的跨轮意图感知KV缓存剪枝方法,显著降低内存占用与延迟。
arXiv:2606.09916v1 Announce Type: cross Abstract: Multi-turn LLM agents fan short queries into long trajectories of tool calls, search results, and in…