1
SCAPE: Accurate and Efficient LLM Training with Extreme Sparse Communication
新论文提出SCAPE方法，通过极端稀疏通信显著降低大模型预训练通信开销，兼顾准确与效率。
arXiv:2607.01678v1 Announce Type: new Abstract: Communication increasingly dominates the cost of Large Language Model (LLM) pre-training, especially u…