1
BlockServe: Block-Grained Continuous Batching for High-Throughput Diffusion LLM Serving
扩散LLM推理新方法：块级连续批处理突破吞吐瓶颈，论文提出BlockServe方案优化服务效率。
arXiv:2607.08930v1 Announce Type: new Abstract: Efficient serving of diffusion large language models (dLLMs) is hindered by convergence heterogeneity:…