1
Don't Let a Few Network Failures Slow the Entire AllReduce
针对网络故障导致AllReduce集体通信降速问题提出解决方案,助力大规模分布式训练。
arXiv:2606.01680v1 Announce Type: cross Abstract: Network failures are among the most frequent hardware faults in large-scale GPU clusters and a leadi…