1
Threshold-Based Exclusive Batching for LLM Inference
挑战LLM推理中的混合批处理惯例，全新阈值独占批处理策略或改写效率规则。
arXiv:2606.00516v1 Announce Type: new Abstract: Mixed batching (MB)--interleaving prefill and decode in a single batch--has become the standard schedu…