1
AiFlow: Token-Native Reactive Orchestration with Bounded Backpressure for Streaming LLM Applications
面向流式LLM应用的Token原生编排方案，用有界背压解决生成式推理的流量控制难题，架构思路值得开发者借鉴。
arXiv:2608.00558v1 Announce Type: cross Abstract: Large language model (LLM) applications increasingly operate as streaming workflows combining retrie…