1
Overcoming the Communication-Performance Tradeoff in LLM Pretraining
突破带宽限制，DiLoCo类方法如何平衡通信与性能，提升LLM预训练效率
arXiv:2508.15706v3 Announce Type: replace Abstract: Communication-efficient distributed training algorithms (e.g., DiLoCo) have received considerable …