1
Unifying Local Communications and Local Updates for LLM Pretraining
这篇论文提出统一本地通信与更新策略，旨在提升大模型预训练的通信效率，分布式训练的新视角。
arXiv:2606.11081v1 Announce Type: cross Abstract: Communication-efficient pre-training of LLMs is increasingly important as training draws on compute …