TallyTrain: Communication-Efficient Federated Distillation
提出一种压缩模型大小与类别数双重带宽瓶颈的联邦蒸馏方法,大幅提升通信效率。
arXiv:2607.00173v1 Announce Type: new Abstract: Federated learning is bandwidth-bound on two orthogonal axes: model size, which limits how often param…
提出一种压缩模型大小与类别数双重带宽瓶颈的联邦蒸馏方法,大幅提升通信效率。
arXiv:2607.00173v1 Announce Type: new Abstract: Federated learning is bandwidth-bound on two orthogonal axes: model size, which limits how often param…
后训练阶段通过形成通信惯例来提升效率,COLM 2025接收论文,揭示多智能体协作新范式。
arXiv:2508.06482v2 Announce Type: replace-cross Abstract: Humans communicate with increasing efficiency in multi-turn interactions, by adapting their …
这篇论文提出统一本地通信与更新策略,旨在提升大模型预训练的通信效率,分布式训练的新视角。
arXiv:2606.11081v1 Announce Type: cross Abstract: Communication-efficient pre-training of LLMs is increasingly important as training draws on compute …
创新性负载均衡与通信优化,FlashCP打破LLM长上下文训练效率瓶颈。
arXiv:2606.08476v1 Announce Type: cross Abstract: Context parallelism (CP) is essential for training large-scale, long-context language models, as it …
通过不确定性感知的机会传输与压缩,大幅降低混合语言模型中设备端与云端之间的通信开销。
arXiv:2505.11788v2 Announce Type: replace-cross Abstract: To support emerging language-based applications using dispersed and heterogeneous computing …