1
FlashCP: Load-Balanced Communication-Efficient Context Parallelism for LLM Training
创新性负载均衡与通信优化，FlashCP打破LLM长上下文训练效率瓶颈。
arXiv:2606.08476v1 Announce Type: cross Abstract: Context parallelism (CP) is essential for training large-scale, long-context language models, as it …