1
CacheWeaver: Cache-Aware Evidence Ordering for Efficient Grounded RAG Inference
面向RAG推理的缓存感知证据排序方案,利用缓存命中优化检索顺序,显著降低响应延迟。
arXiv:2606.19667v1 Announce Type: new Abstract: Retrieval-Augmented Generation (RAG) improves factual grounding, but it also lengthens prompts and rai…