1
Concurrency without Model Changes: Future-based Asynchronous Function Calling for LLMs
无需微调模型,无需修改函数协议,AsyncFC 在纯执行层实现异步并发,让 LLM 解码与函数执行重叠,大幅降低端到端延迟。LLM 对未执行结果(symbolic futures)的推理能力被天然利用,开启模型-工具异步交互新范式。
arXiv:2605.15077v1 Announce Type: cross Abstract: Function calling, also known as tool use, is a core capability of modern LLM agents but is typically…