1
Lelu – Open-source authorization engine for AI agents
开源授权引擎Lelu，专为AI代理设计，支持置信度感知和策略驱动，从个人项目到生产集群都能用。
Article URL: https://lelu-ai.com Comments URL: https://news.ycombinator.com/item?id=48299318 Points: 1 # Comments: 0
2
CONF-KV: Confidence-Aware KV Cache Eviction with Mixed-Precision Storage for Long-Horizon LLM
利用解码步骤的置信度信号，提出混合精度存储的KV缓存逐出策略，有效缓解长序列推理中的GPU内存瓶颈。
arXiv:2605.24786v1 Announce Type: cross Abstract: Long-horizon LLM inference turns the key--value (KV) cache into the dominant GPU memory consumer and…