1
Uncertainty-Aware Sequential Decision Rules for Event-Triggered LLM Invocation in Streaming Systems
流式系统里，如何用不确定性感知决策规则，智能触发LLM调用而避免过量消耗，融合轻量模型实现高效推理。
arXiv:2607.13048v1 Announce Type: cross Abstract: Streaming inference pipelines increasingly pair lightweight fast models with Large Language Models (…